-- Logs begin at Fri 2022-05-27 18:43:59 UTC, end at Fri 2022-05-27 20:17:27 UTC. -- May 27 19:40:29.901182 dv-cinder-839793-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 19:40:29.909432 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 19:40:29 2022] *** May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: nodename: dv-cinder-839793-12-iscsi May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: machine: x86_64 May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: clock source: unix May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: pcre jit disabled May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: detected number of CPU cores: 4 May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: current working directory: / May 27 19:40:29.911401 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: detected binary path: /usr/bin/uwsgi-core May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: your processes number limit is 47680 May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: your memory page size is 4096 bytes May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: detected max file descriptor number: 2048 May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: lock engine: pthread robust mutexes May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: thunder lock: enabled May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 19:40:29.912146 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 19:40:29.956757 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: Python main interpreter initialized at 0x5640126a89c0 May 27 19:40:29.956757 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: python threads support enabled May 27 19:40:29.956757 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: your server socket listen backlog is limited to 100 connections May 27 19:40:29.956757 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: your mercy for graceful operations on workers is 90 seconds May 27 19:40:29.957199 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: mapped 403077 bytes (393 KB) for 2 cores May 27 19:40:29.957199 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: *** Operational MODE: preforking *** May 27 19:40:29.957455 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: *** uWSGI is running in multiple interpreter mode *** May 27 19:40:29.957455 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: spawned uWSGI master process (pid: 110202) May 27 19:40:29.957653 dv-cinder-839793-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 19:40:29.958327 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: spawned uWSGI worker 1 (pid: 110203, cores: 1) May 27 19:40:29.958634 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: spawned uWSGI worker 2 (pid: 110204, cores: 1) May 27 19:40:29.958634 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 19:40:31.132520 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 19:40:31.133209 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 19:40:31.863435 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:40:31.863435 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: from cryptography.utils import int_from_bytes May 27 19:40:31.863713 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:40:31.863713 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: from cryptography.utils import int_from_bytes May 27 19:40:31.863836 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:40:31.863836 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: from cryptography.utils import int_from_bytes May 27 19:40:31.864043 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:40:31.864043 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: from cryptography.utils import int_from_bytes May 27 19:40:34.461899 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:40:34.462481 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:40:34.462656 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:40:34.463015 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:40:34.463268 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:40:34.463647 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.463967 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.464287 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.464603 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.465094 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.465405 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.465727 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.466042 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.466366 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.466632 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.466947 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.467072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:40:34.467443 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-12-iscsi {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.467537 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:40:34.467629 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.467846 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:40:34.467934 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.468160 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.468257 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:40:34.468459 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:40:34.468545 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.468762 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.468848 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469110 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469239 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469423 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469568 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469812 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.469912 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470152 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470349 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470498 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470647 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470787 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.470957 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.471103 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.471289 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.471683 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.471851 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.471941 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472158 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472259 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472474 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472572 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-12-iscsi {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472778 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.472868 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473119 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473230 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473428 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473519 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473801 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.473898 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-12-iscsi {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474111 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474209 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474418 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474527 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474728 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.474819 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.475196 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.475387 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.475581 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.475793 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.475922 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476193 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476294 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476515 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476619 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476822 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.476920 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477172 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477326 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477489 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477662 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477805 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.477908 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478119 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478215 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478416 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478503 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478723 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.478811 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479030 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479129 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-12-iscsi {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479343 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479432 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479744 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.479855 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480062 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480158 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480308 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480486 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480614 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480800 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.480933 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481142 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481272 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481468 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481592 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481792 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.481879 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482072 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482159 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482386 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482475 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482702 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.482798 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483007 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483095 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483314 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483427 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483619 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483711 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.483921 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484012 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484221 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484312 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484523 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484623 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484825 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.484924 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485180 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485269 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485414 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485530 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.485839 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486033 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486155 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486353 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486489 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486679 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486781 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.486932 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487147 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487235 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487395 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487498 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487699 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.487787 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488034 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488121 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488347 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488448 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488651 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488738 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.488991 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489083 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489292 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489389 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489591 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489676 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489894 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.489992 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.490193 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.490298 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.490506 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.490608 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.491342 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.491433 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.491679 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.491774 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.491929 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492055 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492380 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492533 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492781 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.492869 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493060 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493160 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493374 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493530 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493718 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.493817 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494024 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494111 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494327 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494432 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494632 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494735 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.494934 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495037 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495239 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495338 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495537 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495633 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495837 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.495925 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496141 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496230 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496447 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496556 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496748 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.496845 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497021 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497112 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497328 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497417 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497638 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497733 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.497957 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498052 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498259 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498360 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498560 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498661 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498865 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.498951 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499163 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499251 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499464 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499558 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499768 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.499854 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500068 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500154 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500370 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500467 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500680 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.500767 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501000 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501089 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501305 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501406 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501612 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501699 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501907 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.501993 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502210 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502311 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502520 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502622 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502821 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.502908 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503120 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503282 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503418 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503507 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503717 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.503808 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504017 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504114 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504317 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504405 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504616 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504705 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.504915 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505044 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505306 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505397 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505550 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505635 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505865 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.505950 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.506170 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.506246 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507113 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507214 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507448 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507635 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507754 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.507967 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.508044 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.508303 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.508390 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.508632 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.508710 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.508937 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.509034 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.509266 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.509412 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.509575 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.509697 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.509880 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.509999 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.510186 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.510301 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.510490 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.510611 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.511220 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.511319 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.511401 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.511481 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.511561 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.511640 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.511719 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.511810 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.511998 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.512093 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.512305 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.512393 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.512611 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.512707 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.512931 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:40:34.513052 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513266 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513354 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513581 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513665 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513899 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.513990 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514207 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514294 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514521 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514610 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514844 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.514931 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515164 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515276 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515476 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515595 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515814 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.515903 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516152 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516247 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516465 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516554 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516790 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.516891 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517129 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517219 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517438 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517528 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517748 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.517836 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518056 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518144 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518375 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518465 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518689 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518776 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.518998 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519095 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519306 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519400 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519611 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519764 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.519921 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520045 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520231 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520348 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520540 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520653 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.520869 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521027 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521201 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521315 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521512 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521626 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.521826 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522137 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522360 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522503 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522624 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522767 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.522889 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523079 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523231 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523389 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523557 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523679 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.523892 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524024 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524207 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524334 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524529 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524665 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524844 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.524991 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525171 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525261 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525502 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525632 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525810 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.525896 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526095 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526182 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526426 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526518 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526729 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.526826 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527044 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527138 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527350 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527445 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527659 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527756 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.527960 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528049 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528267 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528367 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528576 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528671 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528876 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.528999 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529206 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529314 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529512 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529599 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529815 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.529902 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530115 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530231 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530422 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530510 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530726 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.530816 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531038 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531127 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531346 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531443 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531653 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531741 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.531961 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532049 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532267 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532355 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532584 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532673 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.532896 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533005 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533316 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533543 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533629 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.533942 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534159 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534245 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534474 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534570 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534782 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.534870 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535091 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535216 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535392 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535492 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535696 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535782 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.535994 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536081 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536295 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536393 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536595 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536684 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.536906 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537051 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537230 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537327 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537531 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537619 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.537921 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538017 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538237 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538333 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538659 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538903 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.538991 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539207 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539296 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539508 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539605 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539807 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.539894 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540106 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540196 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540437 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540531 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540735 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.540823 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541074 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541165 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541382 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541474 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541689 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.541791 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542001 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542098 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542307 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542408 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542613 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542709 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.542918 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543006 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543222 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543309 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543525 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543625 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543831 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.543926 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544146 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544233 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544451 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544547 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544768 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.544856 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545105 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545197 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545430 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545523 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545738 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.545826 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546055 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546143 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546357 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546447 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546669 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.546765 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547011 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547099 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547338 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547427 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547649 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547737 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.547968 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548064 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548276 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548364 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548586 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548681 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.548888 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549006 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549234 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549324 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549539 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549628 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549846 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.549943 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550157 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550243 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550461 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550547 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550775 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.550871 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551080 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551168 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551394 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551481 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551697 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.551793 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552011 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552108 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552313 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552403 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552623 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552720 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.552972 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.553064 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.553812 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.553967 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554146 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554278 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554525 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554622 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554838 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.554928 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555150 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555240 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555462 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555558 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555782 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.555918 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556086 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556175 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556388 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556483 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556696 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.556785 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557036 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557130 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557349 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557445 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557656 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557766 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.557960 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558048 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558269 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558364 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558572 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558673 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558873 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.558962 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559172 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559261 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559478 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559574 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559794 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.559920 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560100 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560188 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560415 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560514 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560727 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.560815 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561054 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561143 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561356 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561456 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561670 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561757 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.561976 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562062 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562276 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562380 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562664 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562874 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.562961 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563185 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563273 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563495 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563583 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563793 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.563890 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564095 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564182 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564406 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564501 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564709 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.564802 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565139 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565358 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565446 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565666 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565766 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.565968 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566055 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566273 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566427 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566578 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566679 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566884 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.566972 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567186 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567280 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567494 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567624 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567792 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.567886 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568108 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568205 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568413 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568514 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568720 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.568808 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569146 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569259 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569473 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569620 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569794 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.569946 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.570111 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.570271 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.570423 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.570713 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.570791 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571041 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571120 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571352 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571504 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571661 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571737 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.571971 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572048 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572283 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572369 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572594 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572689 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.572904 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573014 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573253 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573343 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573564 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573662 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573869 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.573956 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574175 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574277 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574477 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574563 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574783 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.574870 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575086 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575184 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575388 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575700 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575809 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.575980 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576077 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576280 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576377 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576581 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576677 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.576884 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577017 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577216 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577307 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577530 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577617 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577832 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.577930 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578141 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578231 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578441 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578538 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578758 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.578846 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579065 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579231 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579365 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579454 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579666 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579753 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.579963 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580068 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580284 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580372 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580588 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580682 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.580896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581002 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581236 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581336 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581547 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581644 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.581941 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582155 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582243 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582467 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582554 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582765 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.582852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583065 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583154 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583363 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583459 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583670 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583766 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.583976 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.584072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.584276 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.584377 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.585119 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.585226 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.585576 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.585665 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.585877 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586056 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586182 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586578 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586787 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.586971 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587069 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587384 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587473 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587697 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587897 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.587998 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.588271 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.588359 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.588579 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.588667 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.588884 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589005 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589212 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589309 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589518 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589611 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589819 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.589916 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590133 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590228 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590433 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590530 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590733 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.590831 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591032 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591121 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591334 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591639 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591729 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.591938 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592026 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592255 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592343 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592559 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592657 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592859 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.592974 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593180 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593269 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593485 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593575 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593783 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.593871 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594081 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594170 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594408 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594550 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594697 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.594786 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595007 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595105 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595305 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595393 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595609 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595705 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.595908 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.596031 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.596210 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.596585 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.596849 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.596988 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597110 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597411 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597504 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597710 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.597886 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598008 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598203 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598292 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598530 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598619 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598846 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.598950 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599155 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599244 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599462 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599552 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599757 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.599854 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.600055 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.600676 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601005 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601276 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601365 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601531 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601621 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.601916 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602223 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602311 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602539 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602628 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602846 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.602961 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603153 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603306 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603461 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603640 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603774 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.603973 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604061 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604300 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604390 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604634 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604729 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.604971 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605061 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605277 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605375 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605601 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605689 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.605912 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606129 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606234 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606335 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606514 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606604 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606820 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.606917 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607165 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607254 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607471 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607559 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607824 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.607920 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608130 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608218 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608446 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608535 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608766 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.608863 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609106 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609196 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609511 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609737 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.609901 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610045 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610134 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610457 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610676 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610764 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.610991 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611080 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611300 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611389 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611606 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611695 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.611923 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612010 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612235 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612323 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612545 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612642 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.612869 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613005 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613212 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613317 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613527 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613627 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613835 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.613924 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614143 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614247 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614457 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614546 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614762 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.614852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615071 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615204 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615382 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615558 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615717 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.615863 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.616149 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.616427 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.616520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.616810 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.616905 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617110 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617209 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617421 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617514 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617734 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.617826 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618050 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618141 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618359 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618496 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618684 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618816 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.618999 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619135 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619342 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619454 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619667 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619755 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.619975 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620076 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620290 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620379 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620598 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620687 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.620986 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621095 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621308 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621405 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621619 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621707 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.621947 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622036 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622259 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622355 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622570 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622657 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622888 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.622977 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.623206 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.623294 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.623515 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.623612 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.623936 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624025 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624252 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624340 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624566 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624655 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624880 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.624982 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625216 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625317 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625525 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625623 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625842 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.625931 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626168 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626378 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626466 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626557 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626771 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.626859 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627077 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627168 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627401 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627499 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627710 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.627807 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628019 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628105 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628348 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628446 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628678 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.628783 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629019 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629113 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629351 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629466 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629771 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.629868 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630084 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630171 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630400 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630487 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630722 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.630810 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.631047 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.631136 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.631842 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.631946 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.632173 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.632335 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.632507 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.632855 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.632945 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633207 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633308 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633522 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633618 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633843 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.633932 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634152 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634251 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634468 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634556 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634787 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.634876 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635102 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635192 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635412 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635507 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635721 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.635831 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636050 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636160 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636370 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636506 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636687 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.636784 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637030 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637122 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637358 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637448 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637684 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637780 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.637997 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638087 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638308 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638395 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638722 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.638923 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639010 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639231 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639319 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639539 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639640 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.639940 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640169 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640259 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640479 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640581 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640787 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.640878 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641155 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641245 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641464 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641565 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641790 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.641878 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642112 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642200 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642432 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642528 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642752 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.642839 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643060 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643156 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643369 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643457 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643678 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643767 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.643982 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644079 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644287 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644376 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644592 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644687 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.644901 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645035 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645241 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645330 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645549 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645645 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645858 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.645955 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646164 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646489 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646614 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646798 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.646971 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.647772 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.647872 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.648140 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.648396 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.648490 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.648673 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.648764 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649009 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649103 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649327 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649415 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649682 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649773 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.649997 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650085 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650302 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650400 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650610 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650699 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.650921 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651010 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651226 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651399 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651532 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651628 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651836 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.651925 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652161 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652263 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652465 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652556 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652791 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.652888 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653129 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653233 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653436 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653526 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653742 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.653830 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654046 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654136 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654388 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654477 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654693 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.654790 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655010 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655098 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655334 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655429 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655657 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.655903 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656008 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656218 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656315 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656543 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656668 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656865 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.656996 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657210 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657304 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657529 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657624 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657842 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658157 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658244 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658470 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658557 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658784 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.658880 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659093 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659187 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659410 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659498 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659727 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.659825 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660048 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660138 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660385 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660583 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660708 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.660912 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661070 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661253 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661401 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661723 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.661891 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.662085 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.662206 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.662405 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.662502 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.662854 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663038 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663241 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663420 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663650 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663764 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.663972 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664090 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664305 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664394 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664631 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664721 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.664991 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665084 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665327 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665428 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665647 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665738 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.665961 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666051 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666371 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666517 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666617 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666689 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666904 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.666993 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667244 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667341 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667554 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667644 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667867 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.667956 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.668187 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.668276 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.668499 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.668593 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.668813 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669059 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669165 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669384 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669481 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669725 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.669822 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670052 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670150 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670366 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670456 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670681 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670769 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.670996 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671098 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671321 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671411 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671631 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671731 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.671943 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672033 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672262 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672358 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672574 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672662 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672881 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.672992 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.673233 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.673427 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.673550 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.673748 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.673851 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674084 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674180 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674412 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674500 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674738 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.674994 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675082 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675350 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675438 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675671 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675769 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.675979 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676074 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676285 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676373 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676599 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676697 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.676910 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677030 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677242 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677331 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677560 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677663 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677869 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.677965 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.678175 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.678283 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.678539 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.678629 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.678940 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.679069 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.679385 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.679480 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.679706 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.679841 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680022 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680164 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680333 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680496 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680651 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680826 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.680976 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.681174 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.681319 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.681487 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.681658 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.681815 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682011 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682131 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682221 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682439 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682530 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682759 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.682859 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683162 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683380 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683470 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683688 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.683778 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684002 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684098 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684311 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684409 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684703 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.684923 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685082 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685255 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685344 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685562 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685649 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685876 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.685975 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686181 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686269 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686489 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686578 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686803 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.686936 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687111 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687202 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687417 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687505 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687725 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.687823 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688030 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688163 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688344 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688432 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688649 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.688752 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689006 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689100 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689295 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689399 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689611 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689864 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.689959 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690199 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690295 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690524 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690621 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690861 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.690958 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691168 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691257 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691477 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691574 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691795 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.691884 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692104 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692199 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692428 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692528 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692741 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.692871 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693082 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693173 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693401 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693504 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693719 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.693809 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.694764 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695031 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695152 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695448 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695537 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695779 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.695868 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696097 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696197 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696415 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696506 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696744 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.696852 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697064 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697146 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697383 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697469 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697700 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.697792 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698020 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698109 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698337 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698435 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698654 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698750 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.698988 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699103 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699285 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699389 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699599 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699687 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.699911 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700009 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700223 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700319 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700534 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700631 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700848 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.700937 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701187 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701277 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701499 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701606 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701813 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.701902 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702128 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702237 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702478 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702580 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702800 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.702945 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703118 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703208 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703437 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703527 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703757 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.703846 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704168 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704385 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704475 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704697 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.704786 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705034 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705126 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705372 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705471 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.705804 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706034 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706133 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706345 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706441 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706661 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706756 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.706970 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707068 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707280 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707378 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707596 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707691 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.707918 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708021 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708230 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708354 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708539 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708627 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708846 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.708935 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.709187 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.709276 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.709559 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.709652 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.709944 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710139 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710287 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710466 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710618 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710783 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.710947 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711102 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711256 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711421 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711564 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711732 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.711895 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712091 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712188 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712355 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712481 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712663 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712795 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.712999 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713129 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713331 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713438 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713605 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713752 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.713915 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714059 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714226 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714365 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714538 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714670 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714846 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.714975 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715183 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715272 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715522 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715612 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715842 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.715931 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716157 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716253 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716462 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716554 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716765 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.716861 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717094 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717197 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717410 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717498 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717717 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.717805 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718023 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718121 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718329 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718455 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718635 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.718939 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719036 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719271 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719359 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719590 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719679 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719907 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.719997 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720224 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720313 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720535 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720630 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720861 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.720996 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.721198 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.721286 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.721792 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.721881 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722116 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722206 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722440 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722529 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722751 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.722853 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723075 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723162 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723387 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723474 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723702 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.723805 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724016 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724104 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724330 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724416 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724641 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724741 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.724969 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.725733 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.725833 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.725941 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.726158 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.726447 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.726552 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.726776 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.726866 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727095 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727193 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727418 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727527 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727735 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.727825 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728047 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728146 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728378 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728467 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728693 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.728900 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729012 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729115 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729337 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729427 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729648 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729737 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.729960 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730050 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730277 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730420 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730593 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730682 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.730851 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:40:34.730940 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.731234 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.731546 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.731873 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.732202 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.732549 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.732868 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.733242 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.733572 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.733889 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.734203 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.734509 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:40:34.734755 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110204) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:40:34.791562 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO dbcounter [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Registered counter for database nova_api May 27 19:40:34.794982 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO dbcounter [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Registered counter for database nova_api May 27 19:40:34.813471 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_db.sqlalchemy.engines [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.814892 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_db.sqlalchemy.engines [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.821117 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writer thread running {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:34.822289 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writer thread running {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:34.879372 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.context [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7766c91-01df-49b1-b027-e27fc837f25b(cell1) {{(pid=110204) load_cells /opt/stack/nova/nova/context.py:464}} May 27 19:40:34.879581 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.context [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7766c91-01df-49b1-b027-e27fc837f25b(cell1) {{(pid=110203) load_cells /opt/stack/nova/nova/context.py:464}} May 27 19:40:34.884086 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:40:34.884478 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_concurrency.lockutils [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:40:34.885693 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:40:34.886089 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_concurrency.lockutils [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:40:34.886483 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:40:34.886887 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_concurrency.lockutils [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:40:34.888457 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:40:34.888854 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_concurrency.lockutils [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110203) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:40:34.890482 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO dbcounter [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Registered counter for database nova_cell0 May 27 19:40:34.890858 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO dbcounter [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Registered counter for database nova_cell0 May 27 19:40:34.894493 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO dbcounter [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Registered counter for database nova_cell1 May 27 19:40:34.894923 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO dbcounter [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Registered counter for database nova_cell1 May 27 19:40:34.902481 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_db.sqlalchemy.engines [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.905962 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_db.sqlalchemy.engines [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.906146 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_db.sqlalchemy.engines [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.907350 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_db.sqlalchemy.engines [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:34.910233 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writer thread running {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:34.912274 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writer thread running {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:34.913922 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writer thread running {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:34.915476 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writer thread running {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:35.064775 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO dbcounter [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Registered counter for database nova_cell0 May 27 19:40:35.065150 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO dbcounter [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Registered counter for database nova_cell0 May 27 19:40:35.073859 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_db.sqlalchemy.engines [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110204) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:35.077182 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG oslo_db.sqlalchemy.engines [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:40:35.078375 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writer thread running {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:35.081640 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writer thread running {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:40:35.486291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: WARNING keystonemiddleware.auth_token [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:40:35.493763 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: WARNING keystonemiddleware.auth_token [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:40:35.512354 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: WARNING keystonemiddleware.auth_token [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:40:35.519555 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: WARNING keystonemiddleware.auth_token [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:40:35.838454 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: WARNING keystonemiddleware.auth_token [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:40:35.844302 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: WARNING keystonemiddleware.auth_token [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:40:35.849858 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640126a89c0 pid: 110204 (default app) May 27 19:40:35.852208 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:40:35.853417 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 May 27 19:40:35.853810 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Fri May 27 19:40:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:40:35.863467 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: WARNING keystonemiddleware.auth_token [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:40:35.869980 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: WARNING keystonemiddleware.auth_token [None req-a04a45a9-dcde-415f-bece-5e18b47b8c81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:40:35.875152 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640126a89c0 pid: 110203 (default app) May 27 19:41:57.085426 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:41:57.086439 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 27 19:41:57.087084 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:41:57.099376 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_api:SELECT=3 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:57.100491 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_cell1:SELECT=3 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:57.101213 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_cell0:SELECT=3 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:57.102608 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:57.550140 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-46e8772f-5e15-407e-b750-253e6b25f9f2 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:41:57.580199 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-46e8772f-5e15-407e-b750-253e6b25f9f2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.486305 May 27 19:41:57.584994 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 19:41:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:41:59.847809 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:41:59.848891 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-5d96ca99-2e53-4686-9735-b593ccbca027 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 27 19:41:59.849559 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:41:59.914361 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-f50e77f1-7ba4-42bc-9231-d74ee9c1e811 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:41:59.933214 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:41:59.933214 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: warnings.warn(msg) May 27 19:42:00.039747 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-f50e77f1-7ba4-42bc-9231-d74ee9c1e811 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.184281 May 27 19:42:00.040313 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:41:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:00.057610 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_api:SELECT=3 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:00.058810 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_cell0:SELECT=3 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:00.059895 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_cell1:SELECT=3 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:00.060627 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:00.265660 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-09bc411a-9883-4bfa-be23-eeb98af38d0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:00.268281 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:42:00.268281 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:42:00.386711 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-09bc411a-9883-4bfa-be23-eeb98af38d0e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337771 May 27 19:42:00.400981 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 19:42:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:02.674241 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-f50e77f1-7ba4-42bc-9231-d74ee9c1e811 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:02.675237 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-f50e77f1-7ba4-42bc-9231-d74ee9c1e811 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 May 27 19:42:02.675638 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:02.781986 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-faf77196-9059-4f69-94c5-cb4d2b27d89f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:02.800483 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:42:02.800483 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:42:02.883466 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-faf77196-9059-4f69-94c5-cb4d2b27d89f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.202001 May 27 19:42:02.884018 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:02.896669 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-4ce4cf61-2f3a-4e43-9af7-6bd24819195e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:02.898221 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:42:02.898221 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: warnings.warn(msg) May 27 19:42:03.000302 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-4ce4cf61-2f3a-4e43-9af7-6bd24819195e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107621 May 27 19:42:03.000533 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 19:42:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:05.267893 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-faf77196-9059-4f69-94c5-cb4d2b27d89f admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:05.268899 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-faf77196-9059-4f69-94c5-cb4d2b27d89f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 27 19:42:05.269434 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:05.333282 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-ef085102-2d20-4f1a-95e7-afa4ff41aacd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:05.419367 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-ef085102-2d20-4f1a-95e7-afa4ff41aacd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143450 May 27 19:42:05.420347 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:05.432620 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-8cefbf76-bbd1-4ab4-bf84-f24fb4476bcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:05.536887 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-8cefbf76-bbd1-4ab4-bf84-f24fb4476bcd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108113 May 27 19:42:05.537733 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 19:42:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:42:07.837793 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-ef085102-2d20-4f1a-95e7-afa4ff41aacd admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:07.838820 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-ef085102-2d20-4f1a-95e7-afa4ff41aacd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 27 19:42:07.839228 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:07.901616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-1ce0f311-2479-49aa-936b-52f06ac8b22e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "swap": 0}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:07.960486 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-1ce0f311-2479-49aa-936b-52f06ac8b22e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114491 May 27 19:42:07.961064 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:07.974216 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-7b8b439f-9e94-4b62-a909-7a37343fbe39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:08.044671 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-7b8b439f-9e94-4b62-a909-7a37343fbe39 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074780 May 27 19:42:08.045289 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 19:42:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:10.460787 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-1ce0f311-2479-49aa-936b-52f06ac8b22e admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:10.461904 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-1ce0f311-2479-49aa-936b-52f06ac8b22e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 27 19:42:10.462527 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:10.522965 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "disk": 20}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:10.595922 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126693 May 27 19:42:10.596743 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:10.608676 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-0e659e0c-e816-4cdb-bd28-2b13ad4c4684 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:10.694116 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-0e659e0c-e816-4cdb-bd28-2b13ad4c4684 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089012 May 27 19:42:10.694708 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 19:42:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:12.971023 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:12.972039 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 May 27 19:42:12.972486 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:13.034321 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-d8aca971-6a77-442e-b8d7-926697f133e8 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:13.059502 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-d8aca971-6a77-442e-b8d7-926697f133e8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080810 May 27 19:42:13.060533 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 19:42:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:15.495740 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:15.496753 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-efd92cf3-afc3-4791-a2e7-5a43a982a8dc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 27 19:42:15.497190 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:15.561696 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-3f3493e2-50fe-4a89-af49-97cef731a5af admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:15.693574 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-3f3493e2-50fe-4a89-af49-97cef731a5af admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.190018 May 27 19:42:15.694395 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:15.706794 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-255b8434-8500-4e1d-be9f-8d2e1582d25b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:15.776067 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-255b8434-8500-4e1d-be9f-8d2e1582d25b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072865 May 27 19:42:15.776799 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 19:42:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:42:18.023440 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-3f3493e2-50fe-4a89-af49-97cef731a5af admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:18.024782 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-3f3493e2-50fe-4a89-af49-97cef731a5af admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 May 27 19:42:18.025380 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:18.085678 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-9a8f5e6e-74fe-4d34-975d-949182de33a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:18.184508 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-9a8f5e6e-74fe-4d34-975d-949182de33a8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.153343 May 27 19:42:18.185175 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:18.201085 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-c71339ed-2801-4e35-829a-7a56a43254f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:18.283645 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-c71339ed-2801-4e35-829a-7a56a43254f6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086251 May 27 19:42:18.284121 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 19:42:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:42:20.511927 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-9a8f5e6e-74fe-4d34-975d-949182de33a8 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:20.512960 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-9a8f5e6e-74fe-4d34-975d-949182de33a8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 27 19:42:20.513442 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:20.571275 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-071cc0e5-febc-411b-afa9-e3a34e8b8b02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:20.639299 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-071cc0e5-febc-411b-afa9-e3a34e8b8b02 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.119443 May 27 19:42:20.639838 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:20.652098 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-b37a81cd-233c-4fb7-ab29-5489939cd093 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:20.715695 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-b37a81cd-233c-4fb7-ab29-5489939cd093 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067189 May 27 19:42:20.718603 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 19:42:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:22.947574 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-071cc0e5-febc-411b-afa9-e3a34e8b8b02 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:22.949088 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-071cc0e5-febc-411b-afa9-e3a34e8b8b02 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 May 27 19:42:22.949293 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:23.017376 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-bc16aedb-965e-48c3-ad56-602f4435b505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:23.108261 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-bc16aedb-965e-48c3-ad56-602f4435b505 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152232 May 27 19:42:23.108967 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:23.120824 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-8351ad65-9a76-4b7a-85d4-bf2249c7598c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:23.221101 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-8351ad65-9a76-4b7a-85d4-bf2249c7598c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103846 May 27 19:42:23.221685 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 19:42:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:25.672229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-bc16aedb-965e-48c3-ad56-602f4435b505 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:25.672229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-bc16aedb-965e-48c3-ad56-602f4435b505 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 27 19:42:25.672229 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:25.734415 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:26.017466 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.340649 May 27 19:42:26.026348 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 19:42:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:26.030227 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-b647d822-79e4-4765-a3ab-d3136701c023 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:26.123140 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-b647d822-79e4-4765-a3ab-d3136701c023 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096912 May 27 19:42:26.124074 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 19:42:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:42:50.977901 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:50.978931 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 27 19:42:50.979326 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:50.990378 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:51.037538 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-ed40e058-fc3f-4865-93e2-22af3ed0f819 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:51.054244 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-ed40e058-fc3f-4865-93e2-22af3ed0f819 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068335 May 27 19:42:51.054882 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 19:42:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:52.058376 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:52.059371 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-6672ea62-6c22-4624-b512-03684b7abd5e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 27 19:42:52.059763 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:52.265567 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-34753ad3-b179-4593-a411-b4d2ea713bb8 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:52.271544 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.wsgi [None req-34753ad3-b179-4593-a411-b4d2ea713bb8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-34753ad3-b179-4593-a411-b4d2ea713bb8 admin admin] Request method failure captured: May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept: application/json May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept-Encoding: gzip, deflate May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Connection: keep-alive May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Content-Length: 0 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Host: 10.222.0.13 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-Api-Version: compute 2.90 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-System-Scope: None May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: User-Agent: python-novaclient May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Auth-Token: gAAAAABikSm8ApApPKuDzDJqjaInEUbtLW-YozWxxYagu_PnBWW4DH3g3X493V8Bswz2yyiruHiZYXUPEV2SX3nBTNjS4G7tqeJp_gWHEKAoxtJG1z3dpop5oKk1IF-y7fjkiWuw9PbVanG1ZQcABtui6BL0hzalc47q6md78cKSOL8Rfxvhe-Q May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Id: None May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Name: None May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Identity-Status: Confirmed May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Is-Admin-Project: True May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Id: default May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Name: Default May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Name: admin May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Role: reader,admin,member May 27 19:42:52.274731 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Roles: reader,admin,member May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant: admin May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Name: admin May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User: admin May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Id: default May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Name: Default May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Name: admin May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: method: > May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: exception: Flavor 42 could not be found. May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: action_args: {'id': '42'} May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:52.279811 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:52.280715 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:52.282362 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-34753ad3-b179-4593-a411-b4d2ea713bb8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:52.283788 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-34753ad3-b179-4593-a411-b4d2ea713bb8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062438 May 27 19:42:52.283788 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 19:42:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 19:42:52.286045 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ace165c5-1cd2-425d-a082-bc33543459ba admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:52.288992 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:52.307264 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-ace165c5-1cd2-425d-a082-bc33543459ba admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024771 May 27 19:42:52.307806 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:52.318339 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-65123b3d-3b13-4381-a400-ebe722bac79f admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:52.340098 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-65123b3d-3b13-4381-a400-ebe722bac79f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025774 May 27 19:42:52.340629 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:42:52.350708 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-3d6d46be-13c9-4d26-9a87-02ba5dc9e275 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:52.356754 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.wsgi [None req-3d6d46be-13c9-4d26-9a87-02ba5dc9e275 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-3d6d46be-13c9-4d26-9a87-02ba5dc9e275 admin admin] Request method failure captured: May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept: application/json May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept-Encoding: gzip, deflate May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Connection: keep-alive May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Content-Length: 0 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Host: 10.222.0.13 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-Api-Version: compute 2.90 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-System-Scope: None May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: User-Agent: python-novaclient May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Auth-Token: gAAAAABikSm8ApApPKuDzDJqjaInEUbtLW-YozWxxYagu_PnBWW4DH3g3X493V8Bswz2yyiruHiZYXUPEV2SX3nBTNjS4G7tqeJp_gWHEKAoxtJG1z3dpop5oKk1IF-y7fjkiWuw9PbVanG1ZQcABtui6BL0hzalc47q6md78cKSOL8Rfxvhe-Q May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Id: None May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Name: None May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Identity-Status: Confirmed May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Is-Admin-Project: True May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Id: default May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Name: Default May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Name: admin May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Role: reader,admin,member May 27 19:42:52.360072 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Roles: reader,admin,member May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant: admin May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Name: admin May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User: admin May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Id: default May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Name: Default May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Name: admin May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: method: > May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: exception: Flavor 42 could not be found. May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: action_args: {'id': '42'} May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:52.365615 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:52.366422 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:52.367520 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-3d6d46be-13c9-4d26-9a87-02ba5dc9e275 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:52.368594 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-3d6d46be-13c9-4d26-9a87-02ba5dc9e275 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014669 May 27 19:42:52.368594 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 19:42:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 19:42:53.237225 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-65123b3d-3b13-4381-a400-ebe722bac79f admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:53.238245 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-65123b3d-3b13-4381-a400-ebe722bac79f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 27 19:42:53.238831 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:42:53.429379 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ef3adea5-dd3b-4d18-b6c6-097c5660d04d admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:53.435302 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.wsgi [None req-ef3adea5-dd3b-4d18-b6c6-097c5660d04d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ef3adea5-dd3b-4d18-b6c6-097c5660d04d admin admin] Request method failure captured: May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept: application/json May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept-Encoding: gzip, deflate May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Connection: keep-alive May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Content-Length: 0 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Host: 10.222.0.13 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-Api-Version: compute 2.90 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-System-Scope: None May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: User-Agent: python-novaclient May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Auth-Token: gAAAAABikSm9QcrJ1wkvLW685SlN0IoTaYrSQmQSlNkwz2vxnPdHZZ9BcbAjpOGUY9mz7rGdK45MXmW5NRtcbNSJ3OcvyynLSg2qfRl7N9Yzac2Q1k4wAbRtyjcz_kTWeLAlTanjU8CgGY3q3KIL4DOkoRVwbbWqlaoFcgYcm9kS5luMeiiDkoQ May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Id: None May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Name: None May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Identity-Status: Confirmed May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Is-Admin-Project: True May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Id: default May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Name: Default May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Name: admin May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Role: reader,admin,member May 27 19:42:53.436896 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Roles: reader,admin,member May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant: admin May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Name: admin May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User: admin May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Id: default May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Name: Default May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Name: admin May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: method: > May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: exception: Flavor 84 could not be found. May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: action_args: {'id': '84'} May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:53.438571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:53.439571 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:53.440709 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ef3adea5-dd3b-4d18-b6c6-097c5660d04d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:53.441898 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-ef3adea5-dd3b-4d18-b6c6-097c5660d04d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061022 May 27 19:42:53.441898 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 19:42:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 19:42:53.448155 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-abb7aa93-c636-4324-a6ad-6b142b7f80d8 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:53.463261 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-abb7aa93-c636-4324-a6ad-6b142b7f80d8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018704 May 27 19:42:53.463788 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:53.473345 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-399167af-4ae6-4449-bbdc-a3262bcb95c8 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:53.487500 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-399167af-4ae6-4449-bbdc-a3262bcb95c8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017643 May 27 19:42:53.488011 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:53.497088 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-04d4b992-26ac-4aa8-b8c0-52a67b9e1ea6 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:53.502528 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.wsgi [None req-04d4b992-26ac-4aa8-b8c0-52a67b9e1ea6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-04d4b992-26ac-4aa8-b8c0-52a67b9e1ea6 admin admin] Request method failure captured: May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept: application/json May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept-Encoding: gzip, deflate May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Connection: keep-alive May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Content-Length: 0 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Host: 10.222.0.13 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-Api-Version: compute 2.90 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-System-Scope: None May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: User-Agent: python-novaclient May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Auth-Token: gAAAAABikSm9QcrJ1wkvLW685SlN0IoTaYrSQmQSlNkwz2vxnPdHZZ9BcbAjpOGUY9mz7rGdK45MXmW5NRtcbNSJ3OcvyynLSg2qfRl7N9Yzac2Q1k4wAbRtyjcz_kTWeLAlTanjU8CgGY3q3KIL4DOkoRVwbbWqlaoFcgYcm9kS5luMeiiDkoQ May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Id: None May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Name: None May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Identity-Status: Confirmed May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Is-Admin-Project: True May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Id: default May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Name: Default May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Name: admin May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Role: reader,admin,member May 27 19:42:53.504003 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Roles: reader,admin,member May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant: admin May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Name: admin May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User: admin May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Id: default May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Name: Default May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Name: admin May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: method: > May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: exception: Flavor 84 could not be found. May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: action_args: {'id': '84'} May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:53.505615 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:53.506575 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:53.507660 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-04d4b992-26ac-4aa8-b8c0-52a67b9e1ea6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:53.508765 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-04d4b992-26ac-4aa8-b8c0-52a67b9e1ea6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011664 May 27 19:42:53.508765 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 19:42:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 19:42:54.373748 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-399167af-4ae6-4449-bbdc-a3262bcb95c8 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:54.374768 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-399167af-4ae6-4449-bbdc-a3262bcb95c8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 27 19:42:54.375154 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:54.563280 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-cdf0e16c-0341-42c9-9ef8-0ddecae12074 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:54.568964 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.wsgi [None req-cdf0e16c-0341-42c9-9ef8-0ddecae12074 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-cdf0e16c-0341-42c9-9ef8-0ddecae12074 admin admin] Request method failure captured: May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept: application/json May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Accept-Encoding: gzip, deflate May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Connection: keep-alive May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Content-Length: 0 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Host: 10.222.0.13 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-Api-Version: compute 2.90 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Openstack-System-Scope: None May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: User-Agent: python-novaclient May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Auth-Token: gAAAAABikSm-UxOqgwCpYBfKxpH-lDZUCXpX0w7bNl9wbeHJVRFEYfc_EZkDul4OepmZ4k13vUQSjwKE-nB1B-uFWCZBNPn37hJR-DyZIRBTWAwAPWHSg2mfA3QjneYl01pazENc6deQzKhrFtTVjB-MOnC-tnE27HHFGENIwjA7w9pjENBGHcY May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Id: None May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Domain-Name: None May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Identity-Status: Confirmed May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Is-Admin-Project: True May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Id: default May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Domain-Name: Default May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Project-Name: admin May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Role: reader,admin,member May 27 19:42:54.570483 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Roles: reader,admin,member May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant: admin May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-Tenant-Name: admin May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User: admin May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Id: default May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Domain-Name: Default May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: X-User-Name: admin May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: method: > May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: exception: Flavor 451 could not be found. May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: action_args: {'id': '451'} May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:54.572047 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:54.573178 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: ERROR nova.api.openstack.wsgi May 27 19:42:54.574598 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-cdf0e16c-0341-42c9-9ef8-0ddecae12074 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110203) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:54.576702 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-cdf0e16c-0341-42c9-9ef8-0ddecae12074 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059956 May 27 19:42:54.576702 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:42:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 19:42:54.582433 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-b003ec06-293e-4fd9-bb1b-6a3cb10a2252 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:54.597602 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-b003ec06-293e-4fd9-bb1b-6a3cb10a2252 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018662 May 27 19:42:54.598062 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:54.607272 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:54.629190 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025372 May 27 19:42:54.629718 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 19:42:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:42:54.639721 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-0f29d139-f6d7-422a-be99-738e3b5aa5ca admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:54.645135 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.wsgi [None req-0f29d139-f6d7-422a-be99-738e3b5aa5ca admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-0f29d139-f6d7-422a-be99-738e3b5aa5ca admin admin] Request method failure captured: May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept: application/json May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Accept-Encoding: gzip, deflate May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Connection: keep-alive May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Content-Length: 0 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Host: 10.222.0.13 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-Api-Version: compute 2.90 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Openstack-System-Scope: None May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: User-Agent: python-novaclient May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Auth-Token: gAAAAABikSm-UxOqgwCpYBfKxpH-lDZUCXpX0w7bNl9wbeHJVRFEYfc_EZkDul4OepmZ4k13vUQSjwKE-nB1B-uFWCZBNPn37hJR-DyZIRBTWAwAPWHSg2mfA3QjneYl01pazENc6deQzKhrFtTVjB-MOnC-tnE27HHFGENIwjA7w9pjENBGHcY May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Id: None May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Domain-Name: None May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Identity-Status: Confirmed May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Is-Admin-Project: True May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Openstack-Nova-Api-Version: 2.90 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Id: default May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Domain-Name: Default May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Project-Name: admin May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Role: reader,admin,member May 27 19:42:54.646616 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Roles: reader,admin,member May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6c2fc958121b4494a2ef337a1cb0b9b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6c2fc958121b4494a2ef337a1cb0b9b4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6c2fc958121b4494a2ef337a1cb0b9b4"}]}] May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant: admin May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Id: 6c2fc958121b4494a2ef337a1cb0b9b4 May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-Tenant-Name: admin May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User: admin May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Id: default May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Domain-Name: Default May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Id: 736ecd08572d41d59ba0fe2db80e313a May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: X-User-Name: admin May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: method: > May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: exception: Flavor 451 could not be found. May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: action_args: {'id': '451'} May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:42:54.648291 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:54.649310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: ERROR nova.api.openstack.wsgi May 27 19:42:54.650597 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-0f29d139-f6d7-422a-be99-738e3b5aa5ca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110204) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:42:54.651818 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-0f29d139-f6d7-422a-be99-738e3b5aa5ca admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012904 May 27 19:42:54.651818 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:42:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 27 19:42:55.519022 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:55.520023 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 27 19:42:55.520608 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:55.713453 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ec4210f8-76de-4867-9df5-5b42b9b27589 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:55.803263 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-ec4210f8-76de-4867-9df5-5b42b9b27589 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.145407 May 27 19:42:55.803791 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 19:42:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:56.676094 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:56.677159 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 27 19:42:56.677550 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:56.868474 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-992dba41-c0a3-472a-b98e-67f1e551dbce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:56.945252 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-992dba41-c0a3-472a-b98e-67f1e551dbce admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129684 May 27 19:42:56.945783 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 19:42:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:57.820546 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:57.821610 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 27 19:42:57.822002 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:58.011458 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-ddd102f2-57ad-499b-988f-75794badc9a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:58.094084 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-ddd102f2-57ad-499b-988f-75794badc9a2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.133082 May 27 19:42:58.094683 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 19:42:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:42:58.971790 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:42:58.972800 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 27 19:42:58.973225 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:42:59.164663 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-fbf07822-2ac2-447c-bf55-b0e4fb50b741 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:42:59.270310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-fbf07822-2ac2-447c-bf55-b0e4fb50b741 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.156799 May 27 19:42:59.270853 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 19:42:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:43:00.141917 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:43:00.143241 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001741 May 27 19:43:00.143773 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:43:00.331195 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-9268b751-adaf-4261-8f08-9164e52adc2a admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:43:00.350504 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-9268b751-adaf-4261-8f08-9164e52adc2a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071145 May 27 19:43:00.351082 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Fri May 27 19:43:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:44:02.772288 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.773847 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-fe9710f5-3d43-42b0-9d29-000e2a1dc7d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 May 27 19:44:02.774245 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:44:02.781778 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:02.834159 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-c4e7f33d-d97d-4b74-9b0d-40db18eb7dad admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.854907 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-c4e7f33d-d97d-4b74-9b0d-40db18eb7dad admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074640 May 27 19:44:02.855434 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:44:02.876034 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG dbcounter [-] [110203] Writing DB stats nova_api:SELECT=14 {{(pid=110203) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:02.879714 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-d9234f77-1a69-45d6-9297-a60306b94153 admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.887413 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-d9234f77-1a69-45d6-9297-a60306b94153 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012769 May 27 19:44:02.887928 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:44:02.899915 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-46f8ba0d-618f-45d5-9799-2148be9928de admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.907697 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-46f8ba0d-618f-45d5-9799-2148be9928de admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011918 May 27 19:44:02.908212 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:44:02.920828 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.928467 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011637 May 27 19:44:02.929147 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:44:02.941474 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-e821f716-81a1-4c61-90aa-6be8fa389290 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:44:02.949257 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-e821f716-81a1-4c61-90aa-6be8fa389290 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011247 May 27 19:44:02.949782 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 27 19:44:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:48:10.195295 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:10.196305 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 May 27 19:48:10.196699 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:48:10.357041 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_api:SELECT=6 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:48:10.472415 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:10.473995 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:48:10.473995 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:48:10.475627 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:10.476205 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:10.477048 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:10.477607 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:10.515695 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-9d307880-08c8-4dc1-adc2-0698d19d9b9a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.160118 May 27 19:48:10.516479 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:48:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:48:11.391798 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:11.392796 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 27 19:48:11.393215 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:48:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:48:11.584310 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:11.586163 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:48:11.586163 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:48:11.587324 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:11.587757 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:11.588720 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:11.589178 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:11.613816 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-cba5cd5e-0435-4c3a-b93d-d39532cadc90 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080245 May 27 19:48:11.614352 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:48:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:48:22.909484 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:22.910487 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 27 19:48:22.910875 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:48:23.059087 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_cell0:SELECT=4 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:48:23.059823 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_cell1:SELECT=4 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:48:23.060423 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG dbcounter [-] [110204] Writing DB stats nova_api:SELECT=8 {{(pid=110204) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:48:23.109771 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:23.110923 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:48:23.110923 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:48:23.112093 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:23.112533 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:23.113368 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:23.113790 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:23.145893 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-539e46b1-f4c3-4fdf-8dac-a08d87bd136d admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085103 May 27 19:48:23.145893 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:48:23 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:48:24.024045 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: DEBUG nova.api.openstack.wsgi [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] Calling method '>' {{(pid=110203) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:24.025089 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: INFO nova.api.openstack.requestlog [None req-025cc0df-3550-4684-8385-966efc30528a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 27 19:48:24.025475 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: [pid: 110203|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 19:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:48:24.218274 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG nova.api.openstack.wsgi [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] Calling method '>' {{(pid=110204) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:48:24.219436 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:48:24.219436 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: warnings.warn(msg) May 27 19:48:24.220674 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:24.221160 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:24.221952 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:48:24.222409 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: DEBUG oslo_concurrency.lockutils [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110204) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:48:24.244787 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: INFO nova.api.openstack.requestlog [None req-536323b0-9335-42c2-9ddc-7ba23b97f682 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080671 May 27 19:48:24.245302 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: [pid: 110204|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 19:48:24 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:49:23.406538 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: Fri May 27 19:49:23 2022 - graceful shutdown triggered... May 27 19:49:23.406660 dv-cinder-839793-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 19:49:23.407626 dv-cinder-839793-12-iscsi devstack@n-api.service[110204]: Gracefully killing worker 2 (pid: 110204)... May 27 19:49:23.408009 dv-cinder-839793-12-iscsi devstack@n-api.service[110203]: Gracefully killing worker 1 (pid: 110203)... May 27 19:49:24.407675 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: worker 1 buried after 1 seconds May 27 19:49:24.407675 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: worker 2 buried after 1 seconds May 27 19:49:24.407675 dv-cinder-839793-12-iscsi devstack@n-api.service[110202]: goodbye to uWSGI. May 27 19:49:24.409337 dv-cinder-839793-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 19:49:24.409898 dv-cinder-839793-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 19:49:24.413003 dv-cinder-839793-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 19:49:24.426629 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 19:49:24 2022] *** May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: nodename: dv-cinder-839793-12-iscsi May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: machine: x86_64 May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: clock source: unix May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: pcre jit disabled May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: detected number of CPU cores: 4 May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: current working directory: / May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: detected binary path: /usr/bin/uwsgi-core May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: your processes number limit is 47680 May 27 19:49:24.445999 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: your memory page size is 4096 bytes May 27 19:49:24.446940 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: detected max file descriptor number: 2048 May 27 19:49:24.446940 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: lock engine: pthread robust mutexes May 27 19:49:24.446940 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: thunder lock: enabled May 27 19:49:24.446940 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 19:49:24.446940 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 19:49:24.498933 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: Python main interpreter initialized at 0x55c45993d9c0 May 27 19:49:24.498933 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: python threads support enabled May 27 19:49:24.498933 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: your server socket listen backlog is limited to 100 connections May 27 19:49:24.498933 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: your mercy for graceful operations on workers is 90 seconds May 27 19:49:24.499384 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: mapped 403077 bytes (393 KB) for 2 cores May 27 19:49:24.499384 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: *** Operational MODE: preforking *** May 27 19:49:24.499624 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: *** uWSGI is running in multiple interpreter mode *** May 27 19:49:24.499624 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: spawned uWSGI master process (pid: 124658) May 27 19:49:24.499837 dv-cinder-839793-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 19:49:24.501252 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: spawned uWSGI worker 1 (pid: 124677, cores: 1) May 27 19:49:24.501252 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: spawned uWSGI worker 2 (pid: 124678, cores: 1) May 27 19:49:24.501252 dv-cinder-839793-12-iscsi devstack@n-api.service[124658]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 19:49:25.708387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 19:49:25.721703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 19:49:26.508768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:49:26.508768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: from cryptography.utils import int_from_bytes May 27 19:49:26.508768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:49:26.508768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: from cryptography.utils import int_from_bytes May 27 19:49:26.516745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:49:26.516745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: from cryptography.utils import int_from_bytes May 27 19:49:26.517197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:49:26.517197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: from cryptography.utils import int_from_bytes May 27 19:49:29.001324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:49:29.001903 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:49:29.002201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:49:29.002495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:49:29.002741 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:49:29.003135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.003465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.003790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.004112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.004446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.004763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.005121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.005537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.005780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.006043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.006365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.006697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-12-iscsi {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.007028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.007331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.007644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.007964 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.008271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.008596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.008907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.009437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.011948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:49:29.012390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.012480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:49:29.012562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.012562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.012712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:49:29.012785 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.012866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:49:29.012941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.013074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:49:29.013433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-12-iscsi {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.013666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.013905 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.014138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.014359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.014579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.014807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.015061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.015319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.015535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.015749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.015967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.016187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.016427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.016647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.016853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.017097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.017322 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.017528 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.017745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.017964 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.018182 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.018402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.018592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-12-iscsi {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.018816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.019911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.020928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.021161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.021161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.021513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.022708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.022860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023209 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.023955 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.024851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.025038 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.025852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-12-iscsi {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026436 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.026905 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.027840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028273 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028273 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.028858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029794 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.029938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.030818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.031106 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.031273 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.031273 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.031665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.031829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.032761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.032981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.032981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.032981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.033446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.033597 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.033841 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.033993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.034211 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.034438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.034648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.034808 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.034999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.035190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.035429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.035591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.035734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.035876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.036896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037262 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037262 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.037873 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038164 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038315 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.038896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039200 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.039786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.040530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.040530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.041506 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.041766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.041766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.043474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.043645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.043803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.043958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.043958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.044843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.045742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.046906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.047781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048498 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.048925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049735 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.049893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.050172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.050313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.050463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.050672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.050836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.051068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.051068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.052017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.052172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.052445 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.052626 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.053504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.053708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054516 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.054964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.055478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.055656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.055809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.055981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056794 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.056970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057563 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057707 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.057988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.058926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059076 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.059866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.060894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.061108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.061253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.061406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.061563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:49:29.061712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.061860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062001 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062309 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062716 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.062984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.063551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.063813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.063980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.064140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.064394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.064554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.064706 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.064904 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065263 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065699 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.065856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066158 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.066996 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.067883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068615 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.068926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.069872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070022 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.070917 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071363 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.071834 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072008 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.072882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.073131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.073667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.073851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074262 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.074979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075281 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.075895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.076815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077421 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077733 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.077885 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078176 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.078923 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079365 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079667 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.079960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.080993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.081901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082618 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.082877 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.083029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.083288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.083872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.084046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.084325 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.084494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.084655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.084906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.085909 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.086997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.087153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.087153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.087447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088110 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.088903 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089249 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089399 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089716 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.089865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090324 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.090942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.091971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.092127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.092275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.092704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.093035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.093199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.093464 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.093995 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.094164 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.094342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.094593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.094749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.094916 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.095920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096080 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096391 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.096845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.097799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098093 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.098966 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099420 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099575 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099723 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.099877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100190 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100512 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.100983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101620 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.101930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.102906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.103115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.104334 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.104549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.104825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.105940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.106860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107018 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107018 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.107956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.108351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.108510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.108659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.108814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.109858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110324 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110792 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.110941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.111869 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.112937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.113913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.114470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.114644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.114830 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115076 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115244 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.115972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116739 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.116901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.117843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118155 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.118988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.119221 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.119409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.119560 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.119717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.119876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.120998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121158 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121306 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121603 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121781 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.121931 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122080 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.122853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.123859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.124016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.124590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.124758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.124920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.125123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.125368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.125647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.125807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.125956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.126113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.126387 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.126544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.126692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.126847 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127320 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127785 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.127948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.128098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.128246 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.128500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.128659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.128816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.129895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130209 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.130989 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.131139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.131295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.131452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.131687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.131859 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.132989 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.133146 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.133305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.133463 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.133613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.133769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.134002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.134172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.134962 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.135139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.135379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.135641 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.135801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.135967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.136228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.136388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.136537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.136700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.136851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137528 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.137993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138844 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.138993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.139938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.140851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.141869 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142167 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.142854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.143947 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.144106 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.144256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.144412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.144667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.145184 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.145363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.145524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.145777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.145954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146106 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146689 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.146848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147148 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.147916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.148921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149589 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149589 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.149871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.150030 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.150763 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151439 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.151927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152682 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.152854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.153865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.154934 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.155435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.155595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.155816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156056 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156795 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.156973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.157931 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.158189 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.158350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.158501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.158650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.158807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159050 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159517 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.159979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160449 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.160905 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161582 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.161904 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162217 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162365 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162804 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.162972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.163925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164545 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164545 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.164940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.165445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.165621 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.166523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.166697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.166949 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.166949 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.167266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.167266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.167571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.167727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.167883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168490 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168646 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.168804 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.169940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.170868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.171959 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.172995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.173971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.174918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.175151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.175584 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.175830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.175995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.176154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.176305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.176461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.176713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.176886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177073 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177225 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177385 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.177994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178159 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.178940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.179968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180282 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.180884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181781 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.181936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.182240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.182398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.182548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.182696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.182844 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.183877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.184972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.185162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.185648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.185822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.185981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.186141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.186305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.186456 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.186628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.186881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187048 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187528 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.187878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188668 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.188818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189000 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189487 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189634 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.189946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190110 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.190896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.191873 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.192838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193031 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.193915 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194063 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194682 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.194990 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.195145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.195294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.195802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.195966 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.196123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.196282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.196453 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.196625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.196785 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197264 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.197737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.198873 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.199972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.200897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.201925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202541 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.202857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.203898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.204055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.204764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.204970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.205133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.205295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.205454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.205951 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206746 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.206894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207515 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.207916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208238 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208401 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208552 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.208870 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209309 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209396 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.209952 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210652 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210748 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.210951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.211937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212130 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212225 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.212509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213326 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.213844 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214347 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.214988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215076 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.215954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216841 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.216927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217122 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.217913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218162 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218616 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.218912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.219925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220118 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220384 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220709 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.220990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221085 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221187 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.221923 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222157 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222308 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.222674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223584 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.223985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224174 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224454 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224728 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.224916 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225217 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225303 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225846 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.225989 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226344 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226669 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.226940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227025 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227596 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.227953 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.228046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.228151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.228151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.228899 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229268 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229268 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229616 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.229881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230130 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.230986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231080 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231252 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.231951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232559 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.232920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233730 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.233966 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234375 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234375 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234375 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234718 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.234988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235076 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235344 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235706 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.235988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236281 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.236897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.237163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.237277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.237494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.237593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.237813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.238825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239754 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.239977 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240646 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.240972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241382 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.241926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.242883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.243833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244574 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.244920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.245987 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246448 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.246944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.247039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.247270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.247374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.248981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.249991 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.250900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251596 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251771 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.251887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252509 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.252838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253070 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253507 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.253807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.254795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255006 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255830 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.255934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256551 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256682 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.256882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257126 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257489 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257651 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.257898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.258108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.258251 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.258415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.258527 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.260202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261763 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.261885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262112 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262232 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262594 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262859 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.262980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263093 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263579 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.263811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.264866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.265953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266081 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266303 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.266925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267050 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.267997 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.268852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.269867 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270519 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.270800 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271022 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.271983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272401 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272618 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.272934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273381 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.273935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.274898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.275015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.275745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.275850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.276113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.276216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.276469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.276607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.276809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.277898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.278043 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:49:29.278183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:49:29.278340 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:49:29.338384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO dbcounter [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Registered counter for database nova_api May 27 19:49:29.338610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO dbcounter [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Registered counter for database nova_api May 27 19:49:29.359844 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_db.sqlalchemy.engines [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.361353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_db.sqlalchemy.engines [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.367739 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writer thread running {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.369037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writer thread running {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.426638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.context [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7766c91-01df-49b1-b027-e27fc837f25b(cell1) {{(pid=124678) load_cells /opt/stack/nova/nova/context.py:464}} May 27 19:49:29.427789 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.context [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d7766c91-01df-49b1-b027-e27fc837f25b(cell1) {{(pid=124677) load_cells /opt/stack/nova/nova/context.py:464}} May 27 19:49:29.430919 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:49:29.432204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:49:29.432978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:49:29.433739 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:49:29.433847 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:49:29.434547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:49:29.435822 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:49:29.436513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:49:29.437855 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO dbcounter [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Registered counter for database nova_cell0 May 27 19:49:29.438537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO dbcounter [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Registered counter for database nova_cell0 May 27 19:49:29.442048 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO dbcounter [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Registered counter for database nova_cell1 May 27 19:49:29.442717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO dbcounter [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Registered counter for database nova_cell1 May 27 19:49:29.450704 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_db.sqlalchemy.engines [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.452436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_db.sqlalchemy.engines [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.455607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_db.sqlalchemy.engines [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.457416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_db.sqlalchemy.engines [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.461025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writer thread running {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.461364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writer thread running {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.462344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writer thread running {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.607800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writer thread running {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.614858 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO dbcounter [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Registered counter for database nova_cell0 May 27 19:49:29.616934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO dbcounter [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Registered counter for database nova_cell0 May 27 19:49:29.626029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_db.sqlalchemy.engines [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.630228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_db.sqlalchemy.engines [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:49:29.634377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writer thread running {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.635588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writer thread running {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:49:29.966339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: WARNING keystonemiddleware.auth_token [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:49:29.966570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: WARNING keystonemiddleware.auth_token [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:49:29.974452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: WARNING keystonemiddleware.auth_token [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:49:29.974956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: WARNING keystonemiddleware.auth_token [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:49:30.323745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: WARNING keystonemiddleware.auth_token [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:49:30.327055 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: WARNING keystonemiddleware.auth_token [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 19:49:30.329947 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: WARNING keystonemiddleware.auth_token [None req-877f9094-ca0a-4b09-acc4-2071c14fe0ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:49:30.333030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: WARNING keystonemiddleware.auth_token [None req-03935f43-7e48-4ff1-98e4-f9c1176e6cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 19:49:30.335273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c45993d9c0 pid: 124677 (default app) May 27 19:49:30.338355 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c45993d9c0 pid: 124678 (default app) May 27 19:50:13.179404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.180447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.181999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.183215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.592004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.595259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.596058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:13.597539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:14.694044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6e7a5ee4-3fef-4d29-bdc8-690b0d7ae0c5 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Action: 'create', calling method: .version_select at 0x7fe1b68cec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1368957755", "metadata": {"Type": "work"}}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:14.730726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a7295599-5380-4873-b2c2-024417817dc0 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Action: 'create', calling method: .version_select at 0x7fe1b68cdd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1698013753", "metadata": {"Type": "work"}}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a7295599-5380-4873-b2c2-024417817dc0 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 122 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:50:14.746296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1698013753", "metadata": {"Type": "work"}}} May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:50:14.747840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1698013753', 'metadata': {'Type': 'work'}}}} May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise error May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi '#$%' May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:14.748714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 19:50:14.750153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 19:50:14.752458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 19:50:14.752458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.754600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a7295599-5380-4873-b2c2-024417817dc0 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:14.758656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a7295599-5380-4873-b2c2-024417817dc0 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.181089 May 27 19:50:14.766451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 19:50:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 19:50:14.777319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f998ec0e-a33a-4425-8900-d222569d2a85 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Action: 'create', calling method: .version_select at 0x7fe1b677d040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1468555516", "metadata": {"Type": "work"}}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f998ec0e-a33a-4425-8900-d222569d2a85 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 120 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:50:14.779985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1468555516", "metadata": {"Type": "work"}}} May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:50:14.781338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1468555516', 'metadata': {'Type': 'work'}}}} May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise error May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi '0' May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:14.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 19:50:14.783488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 19:50:14.784632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 19:50:14.784632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.784632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f998ec0e-a33a-4425-8900-d222569d2a85 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:14.784632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f998ec0e-a33a-4425-8900-d222569d2a85 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011373 May 27 19:50:14.787592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 19:50:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 19:50:14.795983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d52d60a-260f-4db8-b28b-8f75774adae5 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Action: 'create', calling method: .version_select at 0x7fe1b67b2160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-465194871", "metadata": {"Type": "work"}}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d52d60a-260f-4db8-b28b-8f75774adae5 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 118 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:50:14.804266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-465194871", "metadata": {"Type": "work"}}} May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:50:14.808551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-465194871', 'metadata': {'Type': 'work'}}}} May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise error May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi '' May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:14.809480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 19:50:14.811161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 19:50:14.812633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 19:50:14.812633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:14.812633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d52d60a-260f-4db8-b28b-8f75774adae5 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:14.812633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4d52d60a-260f-4db8-b28b-8f75774adae5 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011243 May 27 19:50:14.812633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 3/3] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 19:50:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 19:50:14.815980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-389467cc-1e40-4429-b8a0-0003237d8439 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Calling method '.version_select at 0x7fe1b677dd30>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:16.774275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-389467cc-1e40-4429-b8a0-0003237d8439 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] HTTP exception thrown: Volume tempest-invalid-1087546006 could not be found. May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-389467cc-1e40-4429-b8a0-0003237d8439 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1087546006 HTTP/1.1 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:50:16.778193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Volume tempest-invalid-1087546006 could not be found. May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'tempest-invalid-1087546006'} May 27 19:50:16.779179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1087546006 could not be found. (HTTP 404) (Request-ID: req-61335fb8-3711-41fd-9011-5a1163af1729) May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:16.779765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:50:16.780602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1087546006 could not be found. May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:50:16.781535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1087546006 could not be found. May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1087546006 could not be found. May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:50:16.782434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-389467cc-1e40-4429-b8a0-0003237d8439 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 404 to user: Volume tempest-invalid-1087546006 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:16.783802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-389467cc-1e40-4429-b8a0-0003237d8439 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1087546006" status: 404 len: 99 microversion: 2.1 time: 1.972837 May 27 19:50:16.802677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 19:50:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1087546006 => generated 99 bytes in 1992 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 19:50:16.920678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-391234350", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "networks": [{"uuid": "9a408c2f-cda5-4462-9ea2-f3b5f174a4e8"}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:17.180435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] validate_networks() for [('9a408c2f-cda5-4462-9ea2-f3b5f174a4e8', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:50:17.359517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6e7a5ee4-3fef-4d29-bdc8-690b0d7ae0c5 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.185443 May 27 19:50:17.367175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 1/5] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 19:50:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4188 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 19:50:17.373802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-562492d3-ee16-4935-afa6-4f15e930ec55 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004375 May 27 19:50:17.374355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 2/6] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 19:50:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 19:50:17.392511 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1c5e12f2-8d6b-45ad-8d73-16794ca9e7e6 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b671bdc0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:17.578178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1c5e12f2-8d6b-45ad-8d73-16794ca9e7e6 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 353 microversion: 2.1 time: 0.202786 May 27 19:50:17.580344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:17 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:17.593799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ffa4e752-0076-4d76-a4b0-4b7c09174171 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005444 May 27 19:50:17.594468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 19:50:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 19:50:17.604299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dc99e971-d11b-4c41-9932-7c8819f975db tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Calling method '.version_select at 0x7fe1b671bc10>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:17.735226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-dc99e971-d11b-4c41-9932-7c8819f975db tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] HTTP exception thrown: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dc99e971-d11b-4c41-9932-7c8819f975db tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: DELETE /compute/v2.1/os-volumes/06b0c3ff-519e-425c-af0b-7461425e4532 HTTP/1.1 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:50:17.754195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '06b0c3ff-519e-425c-af0b-7461425e4532'} May 27 19:50:17.755407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. (HTTP 404) (Request-ID: req-c0f38495-dfbd-451f-ae0a-dc80e0de0c87) May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.756126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:50:17.757055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 19:50:17.758555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.772233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dc99e971-d11b-4c41-9932-7c8819f975db tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 404 to user: Volume 06b0c3ff-519e-425c-af0b-7461425e4532 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:17.775585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dc99e971-d11b-4c41-9932-7c8819f975db tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/06b0c3ff-519e-425c-af0b-7461425e4532" status: 404 len: 109 microversion: 2.1 time: 0.165740 May 27 19:50:17.776922 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:50:17 2022] DELETE /compute/v2.1/os-volumes/06b0c3ff-519e-425c-af0b-7461425e4532 => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 19:50:17.795998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-95cd1900-7259-4f96-975a-b631c9a60cd3 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Calling method '.version_select at 0x7fe1b70ae280>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:17.932890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-95cd1900-7259-4f96-975a-b631c9a60cd3 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] HTTP exception thrown: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-95cd1900-7259-4f96-975a-b631c9a60cd3 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Request method failure captured: May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/os-volumes/176e69c7-4c28-4b26-9ff3-415c842212e8 HTTP/1.1 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt1iVdwsC3NRp_kDiVLwYanhL1YKBnkkTNdPRNJ2Nv4fn88gag0RnOAPGjNZRJ6pnZRydgJ_BUbThjx-Thd32yk4G197T_KhRjKPxSGxfGvOrO86O4tXiIagGJULc3YHdHuZioh7o1AivADnN79H_7tqXlNsmxNpfBY6aoNG08GIA8 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:50:17.934890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/23e6266a43c845acaae1c2c2a1ffbfe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_23e6266a43c845acaae1c2c2a1ffbfe8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/23e6266a43c845acaae1c2c2a1ffbfe8"}]}] May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 23e6266a43c845acaae1c2c2a1ffbfe8 May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesNegativeTest-1158554270 May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: a3ef31e3eac944898442f7a273334ec0 May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesNegativeTest-1158554270-project May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '176e69c7-4c28-4b26-9ff3-415c842212e8'} May 27 19:50:17.936317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. (HTTP 404) (Request-ID: req-28909099-0214-4d91-b383-fb0dbc1f878f) May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.937105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:50:17.940319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 19:50:17.941833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-95cd1900-7259-4f96-975a-b631c9a60cd3 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] Returning 404 to user: Volume 176e69c7-4c28-4b26-9ff3-415c842212e8 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-95cd1900-7259-4f96-975a-b631c9a60cd3 tempest-VolumesNegativeTest-1158554270 tempest-VolumesNegativeTest-1158554270-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/176e69c7-4c28-4b26-9ff3-415c842212e8" status: 404 len: 109 microversion: 2.1 time: 0.153039 May 27 19:50:17.942718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:17 2022] GET /compute/v2.1/os-volumes/176e69c7-4c28-4b26-9ff3-415c842212e8 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:50:18.592316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5723c3de-4b42-44a7-9278-7a2112d2bf8e tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b6701af0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:18.822316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5723c3de-4b42-44a7-9278-7a2112d2bf8e tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 354 microversion: 2.1 time: 0.231476 May 27 19:50:18.824013 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 7/11] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:18 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:18.838836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e5652413-a7e7-4b55-9742-bc86b03f2fe1 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b66a01f0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:19.057084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e5652413-a7e7-4b55-9742-bc86b03f2fe1 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 354 microversion: 2.1 time: 0.226124 May 27 19:50:19.057651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 8/12] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:18 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:19.069764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8c829d23-cbf6-4ccf-bbcd-73879e14cfb4 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b6701e50>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:19.229968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:50:19.230908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:50:19.231673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:50:19.232438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:50:19.233538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:50:19.255059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:19.255604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:19.256546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:19.257115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:19.308008 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Getting quotas for project c4362059e243479193d5a02e2e5611a1. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:50:19.318650 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Getting quotas for user 10369664f1914c51893eef1929b7d26b and project c4362059e243479193d5a02e2e5611a1. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:50:19.372094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8c829d23-cbf6-4ccf-bbcd-73879e14cfb4 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 202 len: 0 microversion: 2.1 time: 0.303089 May 27 19:50:19.372588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:50:19.377207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 9/13] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:50:19 2022] DELETE /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:50:19.383352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:50:19.390945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-37bfa551-3cf0-4773-a1d2-8e1ae1cc28ed tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b6701700>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:19.629389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-37bfa551-3cf0-4773-a1d2-8e1ae1cc28ed tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 353 microversion: 2.1 time: 0.241509 May 27 19:50:19.633780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 10/14] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:19 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 353 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:19.780266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7b441427-b298-4bbc-b61d-f1d1d773b652 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.976158 May 27 19:50:19.781875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 5/15] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:50:19.795023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-281d32d9-6cd3-4aca-a072-ce9be69c0035 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:19.796204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-281d32d9-6cd3-4aca-a072-ce9be69c0035 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:19.957516 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-281d32d9-6cd3-4aca-a072-ce9be69c0035 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:20.002570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-281d32d9-6cd3-4aca-a072-ce9be69c0035 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1214 microversion: 2.1 time: 0.209154 May 27 19:50:20.020804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 11/16] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:19 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:20.647922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c405046e-dfb6-4d85-aca0-2f55705f4a75 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b5dabca0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:20.754050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c405046e-dfb6-4d85-aca0-2f55705f4a75 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 353 microversion: 2.1 time: 0.111671 May 27 19:50:20.754967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 6/17] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:20 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:21.030433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-901983ff-8b4f-4223-9dda-a7ea3a3ccffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:21.037053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-901983ff-8b4f-4223-9dda-a7ea3a3ccffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:21.280011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-901983ff-8b4f-4223-9dda-a7ea3a3ccffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:21.303378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-901983ff-8b4f-4223-9dda-a7ea3a3ccffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1214 microversion: 2.1 time: 0.278453 May 27 19:50:21.309351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 12/18] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:21 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:21.767808 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-16ba3d0a-f3d5-4485-adc9-751ae39ab65e tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b5dc2430>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:21.881592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-16ba3d0a-f3d5-4485-adc9-751ae39ab65e tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 353 microversion: 2.1 time: 0.117383 May 27 19:50:21.882341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 7/19] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:21 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:22.321479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-76de73d7-6022-43be-b47d-cf39511adcec tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:22.322851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-76de73d7-6022-43be-b47d-cf39511adcec tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:22.518003 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-76de73d7-6022-43be-b47d-cf39511adcec tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:22.532521 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-76de73d7-6022-43be-b47d-cf39511adcec tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1214 microversion: 2.1 time: 0.214988 May 27 19:50:22.533471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 13/20] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:22 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:22.902263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6a4e787d-249b-4cfc-98fc-71bf28b71724 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b5dabe50>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:23.004225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6a4e787d-249b-4cfc-98fc-71bf28b71724 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 200 len: 353 microversion: 2.1 time: 0.108043 May 27 19:50:23.004727 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 8/21] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:22 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:23.408599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cc8ee54a-b8ac-43ce-9782-41e209ad2224 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: .version_select at 0x7fe1b66549d0>, body: {"keypair": {"name": "tempest-keypair-1872259326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyifO2y0k01ICI08zw2QuKIUduuo5RDkUV8NY7t50Mk1VfLiCF8lfWSDDXTbSXl8BF8zoEdVZDQcQcddRrurXZtAt2xPwbbhklI9LC3DzQNyXV6EdLeU9XK0NvMs2y7SA=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:23.534148 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-cc8ee54a-b8ac-43ce-9782-41e209ad2224 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for project 2efe5f8c717640528624dc103744dcf4. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:50:23.550029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:23.550967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:23.560532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-cc8ee54a-b8ac-43ce-9782-41e209ad2224 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for user ed8754ddcfd54c24ac923db0fedc1606 and project 2efe5f8c717640528624dc103744dcf4. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:50:23.608832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:23.610406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:23.611466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:23.612048 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:23.755133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cc8ee54a-b8ac-43ce-9782-41e209ad2224 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.561945 May 27 19:50:23.760143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 14/22] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 19:50:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 567 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 19:50:24.016737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e10f3b41-0b7f-4386-8391-77816c5c7319 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Calling method '.version_select at 0x7fe1b5dd25e0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:24.067151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:24.141682 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c226d2c4-d75b-4dcc-bf07-750c74433530 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1218 microversion: 2.1 time: 0.596441 May 27 19:50:24.149052 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 9/23] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:23 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1218 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:24.224484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-e10f3b41-0b7f-4386-8391-77816c5c7319 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] HTTP exception thrown: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e10f3b41-0b7f-4386-8391-77816c5c7319 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Request method failure captured: May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f HTTP/1.1 May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt1L1pMbRcdv2e_OPaSr-7S65rw5JJGccJ4m7QMj5hSNbH47Sub_vMWDYKTyCDMJxRLpr6S2lL4pLophnPnECGb_Sq_dQhdjy9PXiLlNPuyTo4Ced19YwR7OfluzS6J3EkS41B0IGGajxN3dX3DbczTJuHLQaTqyumx-x2NxTJH1oM May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 7241472ff5c44725bda3e741d79d474d May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesGetTestJSON-1866921523 May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:50:24.229331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7241472ff5c44725bda3e741d79d474d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7241472ff5c44725bda3e741d79d474d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7241472ff5c44725bda3e741d79d474d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7241472ff5c44725bda3e741d79d474d"}]}] May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesGetTestJSON-1866921523 May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 7241472ff5c44725bda3e741d79d474d May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesGetTestJSON-1866921523 May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesGetTestJSON-1866921523-project May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 814653f467b14218849d4b7135da0f08 May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesGetTestJSON-1866921523-project May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f'} May 27 19:50:24.230782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. (HTTP 404) (Request-ID: req-887aff4a-2ba5-4730-a177-90440755131a) May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:24.231666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:50:24.232872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 19:50:24.234253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e10f3b41-0b7f-4386-8391-77816c5c7319 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] Returning 404 to user: Volume 5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e10f3b41-0b7f-4386-8391-77816c5c7319 tempest-VolumesGetTestJSON-1866921523 tempest-VolumesGetTestJSON-1866921523-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f" status: 404 len: 109 microversion: 2.1 time: 0.215583 May 27 19:50:24.236027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 15/24] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:24 2022] GET /compute/v2.1/os-volumes/5e0ff5bb-c7db-4c57-bf6b-08bf8e6c9a0f => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:50:25.098659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f3581d75-19dc-4e30-9a7a-476112fa0b6d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: .version_select at 0x7fe1b5dabe50>, body: {"keypair": {"name": "tempest-keypair-1791077963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL1buHnNKxYx/GGyTRSZPIhJZT7ivcz0xZ6pvulyvb4otWgg8AJh7qu+iMnjj41U42AouMkoQA4cA4m+PFscgfMUPU9n+xhiVQoG22mciyHuUqQatMZJwMeQ3ZNBI+AiQ=="}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:25.170147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:25.171129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:25.192790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:25.193400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:25.194257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:25.204178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:25.204333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f3581d75-19dc-4e30-9a7a-476112fa0b6d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:50:25.217618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f3581d75-19dc-4e30-9a7a-476112fa0b6d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:50:25.410034 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f3581d75-19dc-4e30-9a7a-476112fa0b6d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.740679 May 27 19:50:25.411102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 10/25] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:50:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:25.749385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:25.770327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b121b83f-c003-4669-91e6-8abde1ce8f0a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1274 microversion: 2.1 time: 0.609006 May 27 19:50:25.775824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 16/26] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:25 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1274 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:26.789646 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:26.790562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:26.812340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:26.812922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:26.814484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:26.814892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:27.051786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:27.061357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1daf7536-d527-4f32-81a0-acbd78f3a8c7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1272 microversion: 2.1 time: 0.277195 May 27 19:50:27.074735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 11/27] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:26 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:28.078561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:28.079234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:28.086801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:28.087246 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:28.107196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:28.107873 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:28.441306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:28.452388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-53ebe326-8d10-446d-b5cd-0f1c33b33ce0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1272 microversion: 2.1 time: 0.376364 May 27 19:50:28.453211 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 17/28] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:28 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:29.475444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:29.477447 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:29.485474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:29.512542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:29.514187 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:29.516514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:29.517132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:29.686925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:29.701568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f94c3586-eb9a-4c29-bd24-49c881587bf5 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1272 microversion: 2.1 time: 0.231652 May 27 19:50:29.705929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 12/29] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:29 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:30.471498 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1402352056", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02c48a8e-6dcb-40bc-b8d2-b504da81ca3c"}], "security_groups": [{"name": "tempest-securitygroup--141969868"}], "key_name": "tempest-keypair-1872259326", "user_data": "}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:30.790398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:30.790398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:30.790398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:30.790398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:30.793260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:30.793260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:30.822068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] validate_networks() for [('02c48a8e-6dcb-40bc-b8d2-b504da81ca3c', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:50:31.008137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:31.027704 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d5f3717f-2434-4a8f-8e2a-52da956a7147 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.307610 May 27 19:50:31.040477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 13/30] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:30 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:31.775191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746027525", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc686edf-9590-4ae1-ab4c-4d4524b126ab"}], "security_groups": [{"name": "tempest-securitygroup--695502355"}], "key_name": "tempest-keypair-1791077963", "user_data": "}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:32.186056 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] validate_networks() for [('dc686edf-9590-4ae1-ab4c-4d4524b126ab', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:50:33.595971 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=10 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:33.712631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:50:33.713274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:50:33.718192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:50:33.719532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:50:33.720119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:50:33.750819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:33.751752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:33.752714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:33.753324 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:33.826275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:50:33.826275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:50:33.843147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:50:33.846581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:50:33.865410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:50:33.866994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:50:33.869824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:50:33.872223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:50:33.872223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:50:33.893153 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:33.895711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:33.898023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:33.900548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:33.954468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for project 2efe5f8c717640528624dc103744dcf4. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:50:33.965757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for user ed8754ddcfd54c24ac923db0fedc1606 and project 2efe5f8c717640528624dc103744dcf4. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:50:34.011661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:50:34.020838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:50:34.078139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-38a2c5e8-a519-4d43-8ec4-0421fab66a1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.313179 May 27 19:50:34.093570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 14/31] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:50:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 19:50:34.103812 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:34.104483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:34.121449 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:34.121907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:34.122704 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:34.123147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:34.267407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a62c6722-f9ef-437d-a175-36b068910d3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.802175 May 27 19:50:34.282500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 18/32] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 19:50:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 19:50:34.295950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-765e279a-d2bb-4782-bdf9-d02683dc78e1 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b5cbe160>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:34.532303 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-765e279a-d2bb-4782-bdf9-d02683dc78e1 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dbcf57e3-3882-4416-87b2-0743aed3554e" status: 200 len: 350 microversion: 2.1 time: 0.246927 May 27 19:50:34.533751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 19/33] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:34 2022] GET /compute/v2.1/os-volumes/dbcf57e3-3882-4416-87b2-0743aed3554e => generated 350 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:34.540712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4a9097cc-f01f-41f7-a7bd-29bfc83ac7f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:34.541572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4a9097cc-f01f-41f7-a7bd-29bfc83ac7f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:34.727183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4a9097cc-f01f-41f7-a7bd-29bfc83ac7f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:34.737336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4a9097cc-f01f-41f7-a7bd-29bfc83ac7f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1241 microversion: 2.1 time: 0.199351 May 27 19:50:34.737969 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 20/34] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:34 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1241 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:34.757973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:34.758936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:34.856217 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:34.870371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9d6dbe21-8e25-4bf4-9e87-c0358c61b3d7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.775451 May 27 19:50:34.871793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 15/35] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:34 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:34.888152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:34.896973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:34.908783 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:34.910264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dad60887-9fe0-4e0e-9f02-5f0ea54503aa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1282 microversion: 2.20 time: 0.159038 May 27 19:50:34.919532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 21/36] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:34 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:35.764388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3c2bab10-9f5b-4202-909d-3b606de02cb3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:35.765242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3c2bab10-9f5b-4202-909d-3b606de02cb3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:35.841600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-881f5615-4dbf-4582-a4a7-a5628d03516a req-c4b62c54-5f7c-48dd-98af-6cbab26eadae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb10669a-44f0-4557-9139-37ea8c867ebc", "tag": "f7b06425-d7f4-43f7-9984-06401d17896b"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:35.856163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3c2bab10-9f5b-4202-909d-3b606de02cb3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:35.857652 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-881f5615-4dbf-4582-a4a7-a5628d03516a req-c4b62c54-5f7c-48dd-98af-6cbab26eadae service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:35.858747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-881f5615-4dbf-4582-a4a7-a5628d03516a req-c4b62c54-5f7c-48dd-98af-6cbab26eadae service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:35.883082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3c2bab10-9f5b-4202-909d-3b606de02cb3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1241 microversion: 2.1 time: 0.129143 May 27 19:50:35.884381 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 22/37] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:35 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:35.891465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:35.891836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-881f5615-4dbf-4582-a4a7-a5628d03516a req-c4b62c54-5f7c-48dd-98af-6cbab26eadae service nova] Creating event network-changed:f7b06425-d7f4-43f7-9984-06401d17896b for instance bb10669a-44f0-4557-9139-37ea8c867ebc on hv-cinder-83979 May 27 19:50:35.892577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-881f5615-4dbf-4582-a4a7-a5628d03516a req-c4b62c54-5f7c-48dd-98af-6cbab26eadae service nova] Acquired lock "compute-rpcapi-router" {{(pid=124678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 19:50:35.893939 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:35.894614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:35.895710 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:35.896394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:35.897435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:35.911328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:35.911782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:35.912602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:35.913117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:35.920298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.compute.rpcapi [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 19:50:35.921232 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] Releasing lock "compute-rpcapi-router" {{(pid=124678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 19:50:35.974860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bb63e57e-3365-4c6d-ba4c-76728db7c5cd None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223995 May 27 19:50:35.974860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 16/38] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:50:35.974860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:35.977640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:36.094805 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:36.122448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:36.122448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:36.122448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-25a58119-3172-49c8-ab7d-275883b4bb32 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1282 microversion: 2.20 time: 0.150922 May 27 19:50:36.122793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 17/39] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:35 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:36.208848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:36.221188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-25ee8973-b748-4ec8-8ddc-ce8b33660294 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.334529 May 27 19:50:36.231719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 23/40] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:35 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:36.901949 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:36.903447 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:36.910470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:36.910945 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:36.911755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:36.912219 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:36.983880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:36.991672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e551be15-08f2-4b6a-bef8-cf12eca23c9d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.095745 May 27 19:50:36.992653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 18/41] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:36 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:37.138313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:37.138916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:37.144842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:37.145331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:37.146069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:37.146501 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:37.206267 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:37.216312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:37.216312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:37.218637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-24b91498-09c3-4d72-b939-f01dfa7deaac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1286 microversion: 2.20 time: 0.082968 May 27 19:50:37.221670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 24/42] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:37 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:37.247172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:37.254343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:37.270132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:37.270593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:37.271379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:37.271853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:37.423867 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:37.431837 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b0caae83-1450-43a1-a11b-e59e835ff2a2 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.196126 May 27 19:50:37.432701 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 19/43] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:37 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:38.024354 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:38.025978 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:38.044845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.045333 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.046160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.046599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.125545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:38.148182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d771c7aa-8064-41bd-9134-bb8d4b6a3bcf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.135323 May 27 19:50:38.150139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 25/44] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:38 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:38.236143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:38.236748 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:38.257838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.258898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.263279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.263726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.356097 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:38.363942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:38.365720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:38.367159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e0188e4c-3f08-4e1c-a5ff-a85c7a1c5435 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1286 microversion: 2.20 time: 0.135243 May 27 19:50:38.369352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 20/45] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:38 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:38.449656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:38.451483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:38.457449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.458226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.466449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:38.466984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:38.615260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:38.624238 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6e40b209-eb0a-43ce-b72c-b29b00acd8f6 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.178466 May 27 19:50:38.635866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 26/46] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:38 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:38.947727 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-61023756-c6b8-4ae0-b072-f50932e11228 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b4c50af0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:39.010335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-61023756-c6b8-4ae0-b072-f50932e11228 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ccaa6c8d-556c-4874-bbed-c5185d36b3ca" status: 200 len: 350 microversion: 2.1 time: 0.068865 May 27 19:50:39.017514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 21/47] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:38 2022] GET /compute/v2.1/os-volumes/ccaa6c8d-556c-4874-bbed-c5185d36b3ca => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:39.166837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:39.168346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:39.176929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.181738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.182812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.183827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.285212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:39.295744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a2d4f1c4-606a-4160-bd89-8e6a8107491e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.133672 May 27 19:50:39.296880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 27/48] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:39 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:39.392796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:39.394387 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:39.437324 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.437916 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.438956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.439551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.643879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:39.644500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:39.651864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.652703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.653889 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:39.654638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:39.682977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:39.692258 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:39.694751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:39.696250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-eed8cf4b-7e73-4e9f-b24a-72f664dd2c55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1286 microversion: 2.20 time: 0.310575 May 27 19:50:39.697328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 22/49] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:39 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1286 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:39.865627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:39.874534 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e98be507-3314-486c-b3d1-50c0d19077cc tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.234843 May 27 19:50:39.885177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 28/50] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:39 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:40.321791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:40.322738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:40.330483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.341109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:40.341109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.341109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:40.414945 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:40.425678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ccc5dd8a-ec06-427d-941f-749faa6c5280 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.113141 May 27 19:50:40.426664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 23/51] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:40 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:40.725598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:40.726578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:40.733226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.733689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:40.734461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.734960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:40.800258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:40.812651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:40.814544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:40.815752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-50e46044-9af0-443f-8e00-53b162033c1a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1286 microversion: 2.20 time: 0.105235 May 27 19:50:40.816313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 29/52] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:40 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:40.893736 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:40.894490 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:40.902614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.903216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:40.904105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:40.904643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:41.047933 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:41.056017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-466933bd-a606-4c9c-b386-747a037ff31d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.167391 May 27 19:50:41.072543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 24/53] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:40 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:41.454465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:41.455427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:41.466080 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:41.466533 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:41.467339 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:41.467791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:41.534458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:41.542808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3514f916-51d3-43c0-a846-93c3cf402a23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.101620 May 27 19:50:41.543381 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 30/54] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:41 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:41.835566 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:41.836345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:41.842450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:41.842912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:41.843929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:41.844369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:41.921379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:41.931552 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:41.933858 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:41.935372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a7528d85-2652-4516-b76d-5c9ba4f99ad5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1286 microversion: 2.20 time: 0.103892 May 27 19:50:41.935999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 25/55] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:41 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:42.090063 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.091298 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:42.101163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.101163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:42.101163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.101455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:42.154150 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-27dcf4b4-18e3-44c3-a4e3-b567268c3dd5 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b4bd19d0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.265133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:42.277567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-80fe4c6b-1779-498a-8166-ff45d5390b9d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.185837 May 27 19:50:42.277567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 31/56] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:42.311432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-27dcf4b4-18e3-44c3-a4e3-b567268c3dd5 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/7d28f45d-1db3-438e-87af-a00bbcc1322d" status: 200 len: 351 microversion: 2.1 time: 0.161304 May 27 19:50:42.313538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 26/57] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes/7d28f45d-1db3-438e-87af-a00bbcc1322d => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:42.325150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e455dad8-80af-4d67-a492-d59e46def133 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b5cce5e0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.508755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e455dad8-80af-4d67-a492-d59e46def133 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.187790 May 27 19:50:42.509359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 32/58] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:42.535349 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6ed9c26f-0805-40f6-9415-68dd94492aff tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b4bd1700>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.564491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.565130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:42.599999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.600647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:42.602911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.604559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:42.680899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6ed9c26f-0805-40f6-9415-68dd94492aff tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.159586 May 27 19:50:42.690123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 27/59] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:42.700940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4b1107c2-6932-48e0-a658-b304e1f56a7c tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b4c8d0d0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.757178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:42.765453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3b225bb2-8b60-422c-af7d-1784efbfb7ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1245 microversion: 2.1 time: 0.205506 May 27 19:50:42.777594 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 33/60] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:42.810690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4b1107c2-6932-48e0-a658-b304e1f56a7c tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.119583 May 27 19:50:42.813074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 28/61] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:42.822239 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8ce8c669-a962-4237-9313-ec9ca67ffd76 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b5cce4c0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.904535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8ce8c669-a962-4237-9313-ec9ca67ffd76 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086073 May 27 19:50:42.905277 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 34/62] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:42.917606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2fafa791-0af5-4ca1-ad13-bca39ec63f26 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b54b4550>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.963374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:42.963374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:42.963374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.963374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:42.964336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:42.964336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:43.014119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2fafa791-0af5-4ca1-ad13-bca39ec63f26 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.100730 May 27 19:50:43.014789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 29/63] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:43.027264 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4010fcb6-2b8b-4d82-a42e-de047b717411 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b4c5b310>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:43.040840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:43.053866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:43.055418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:43.056532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-995e4e17-3827-448c-977b-b3f1b5cba8ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1278 microversion: 2.20 time: 0.106359 May 27 19:50:43.060986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 35/64] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:42 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:43.109235 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4010fcb6-2b8b-4d82-a42e-de047b717411 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086245 May 27 19:50:43.109806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 30/65] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 19:50:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:43.122101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7f2f7193-a05e-4451-8ce4-4c111ade89cc tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b5cce430>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:43.202069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7f2f7193-a05e-4451-8ce4-4c111ade89cc tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083821 May 27 19:50:43.202673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 36/66] 10.222.0.13 () {58 vars in 1187 bytes} [Fri May 27 19:50:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:43.214516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-faac02bc-e96b-443f-9d79-27c1b0941862 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] Calling method '.version_select at 0x7fe1b54c0f70>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:43.285651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:43.286257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:43.293151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:43.293602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:43.294422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:43.294864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:43.328285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-faac02bc-e96b-443f-9d79-27c1b0941862 tempest-VolumesTestJSON-153085482 tempest-VolumesTestJSON-153085482-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.117248 May 27 19:50:43.329577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 31/67] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 19:50:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:43.478072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:43.485685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-547dc407-2079-41c7-b9a8-913b20ac1621 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.203805 May 27 19:50:43.486428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 37/68] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:43 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:43.783061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:43.783662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:43.785659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:43.790467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:43.797771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:43.797771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:43.797771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:43.852616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:43.859984 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e0af2099-484d-40b7-beac-6f7281540927 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1293 microversion: 2.1 time: 0.080829 May 27 19:50:43.860537 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 32/69] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:43 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:44.077891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:44.078380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:44.080223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:44.080932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:44.086184 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.086627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.087542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.088014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.150112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:44.157963 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:44.159469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:44.168752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-734f4db6-19b4-48ea-9ba5-e1289d0d8e1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1334 microversion: 2.20 time: 0.086892 May 27 19:50:44.168752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 38/70] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:44 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:44.503452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:44.504114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:44.511660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.512222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.513477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.513598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.516825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=87 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:44.643021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:44.650809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ca0d6f39-7274-410a-9b2b-8ad5f853b519 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.151342 May 27 19:50:44.651315 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 33/71] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:44 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:44.876975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:44.877628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:44.885292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.886230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.886723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:44.887166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:44.954010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:44.962843 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9effb077-dabd-4d83-a264-da58bb398f36 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1293 microversion: 2.1 time: 0.089749 May 27 19:50:44.963513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 39/72] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:44 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:45.181514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:45.181896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:45.188328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.188766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:45.189557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.189988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:45.259693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:45.267809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:45.269367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:45.270514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6eaf782a-3a7e-4ad4-8495-562256960109 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1334 microversion: 2.20 time: 0.093837 May 27 19:50:45.271072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 34/73] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:45 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:45.668111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:45.668664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:45.674754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.675194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:45.675949 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.676373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:45.680879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:45.808876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:45.816482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-82d961b1-f1e7-4117-9380-cc639ade6cbf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.152783 May 27 19:50:45.820113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 40/74] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:45 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:45.980551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:45.981201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:45.983124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:45.987956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.988400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:45.989194 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:45.989627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:46.051288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:46.059660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-01b564cc-867f-4990-88bf-11eaad47cbff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1293 microversion: 2.1 time: 0.082914 May 27 19:50:46.060220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 35/75] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:45 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:46.288722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:46.289405 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:46.291667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=12 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:46.296513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:46.296981 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:46.297790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:46.298224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:46.361404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:46.370188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:46.371854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:46.372871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d757050c-4024-43cd-86f3-4da133d2f9ae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1334 microversion: 2.20 time: 0.088261 May 27 19:50:46.373458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 41/76] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:46 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:46.837341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:46.840617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:46.840617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=18 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:46.845929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:46.846570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:46.847799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:46.848412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:46.988938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:46.997148 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-53b3f39d-9273-4ea6-a476-27cec1e6fb8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.165532 May 27 19:50:46.997780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 36/77] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:46 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:47.080188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:47.080188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:47.084663 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:47.085177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:47.086357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:47.086869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:47.180467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:47.193349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a21741d6-3109-4ebc-b60a-36744a259267 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1293 microversion: 2.1 time: 0.116913 May 27 19:50:47.193349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 42/78] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:47 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:47.392489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:47.393578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:47.405533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:47.406321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:47.407326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:47.407755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:47.495260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:47.515330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:47.526828 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:47.528011 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-46a205c3-df54-42b9-8b24-e2f600371ab7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1342 microversion: 2.20 time: 0.140019 May 27 19:50:47.539389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 37/79] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:47 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1342 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:48.014029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:48.014981 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:48.021449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.022165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.023738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.024732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.207842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:48.209124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:48.216528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.218508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.219799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.220440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.269442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:48.280440 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3bd48dfa-2ee3-41fa-a12b-34a91f619f76 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.270194 May 27 19:50:48.281274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 43/80] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:48 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:48.359969 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:48.378472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6f4a34bf-d13a-4694-af62-5c4fe370d862 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1311 microversion: 2.1 time: 0.169436 May 27 19:50:48.381392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 38/81] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:48 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:48.546543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:48.546962 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:48.557139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.557581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.558351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:48.562196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:48.662334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:48.677099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:48.680912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:48.682665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-479ccb05-b30d-4514-93ff-700dd7471d69 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1340 microversion: 2.20 time: 0.139837 May 27 19:50:48.694611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 44/82] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:48 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1340 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:49.307461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:49.308831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:49.323379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.323850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.326503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.328004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.407951 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:49.414486 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:49.437851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.438547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.439399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.439839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.747630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:49.756608 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4d9a61e8-735f-43a6-87ed-a3cd07093603 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.461843 May 27 19:50:49.759544 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 39/83] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:49 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:49.764630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:49.765538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:49.772379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.773758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.775225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:49.776697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:49.818571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:49.828874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-af603586-951f-4ac3-95e1-884c2733a8d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.426672 May 27 19:50:49.833291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 45/84] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:49 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:50.207497 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:50.214958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:50.217843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:50.221233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-20b8ca59-ce55-40ea-a955-3ff26038399e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.458673 May 27 19:50:50.234514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 40/85] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:49 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:50.644518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-f0a41b5b-7170-43f3-a596-126b8224dcc1 req-b5972a6d-5b56-4349-9fbc-e3bdffea8204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:50.659616 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-f0a41b5b-7170-43f3-a596-126b8224dcc1 req-b5972a6d-5b56-4349-9fbc-e3bdffea8204 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.660212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-f0a41b5b-7170-43f3-a596-126b8224dcc1 req-b5972a6d-5b56-4349-9fbc-e3bdffea8204 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.695792 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-f0a41b5b-7170-43f3-a596-126b8224dcc1 req-b5972a6d-5b56-4349-9fbc-e3bdffea8204 service nova] Creating event network-changed:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:50:50.696408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-f0a41b5b-7170-43f3-a596-126b8224dcc1 req-b5972a6d-5b56-4349-9fbc-e3bdffea8204 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 19:50:50.697796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.718017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.718017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.718017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.718017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.compute.rpcapi [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 19:50:50.718017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] Releasing lock "compute-rpcapi-router" {{(pid=124677) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 19:50:50.732365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1a588273-e40c-4661-b17b-687dfd523a3e None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093318 May 27 19:50:50.733329 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 46/86] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:50:50.776419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:50.781653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:50.791031 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.791783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.793804 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.794526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.852045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:50.852860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:50.865842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.867088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:50.868119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:50.868980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:51.082425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:51.091725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c5cb5344-562b-4b31-8d24-848577398a1e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.249514 May 27 19:50:51.092314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 47/87] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:50 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:51.240377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:51.251150 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9e367fd1-c518-4865-a91b-d10fe6971444 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.479279 May 27 19:50:51.253864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 41/88] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:50 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:51.262216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:51.262864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:51.269079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:51.269530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:51.270583 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:51.271270 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:51.440703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:51.457062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:51.458634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:51.459764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d28601c1-01b4-4a13-a45a-b9eec7a2765e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.211456 May 27 19:50:51.460364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 48/89] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:51 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:52.070085 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-0311bb42-aec5-4441-9cc2-40be7a9f6d5f req-adc21e6d-edb0-4a7a-b81f-0285beb0a8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6870d2-0e10-4d9d-b00a-35b77afceb0d", "tag": "b0920c8f-86db-4b0c-8e65-a7d5286779ee"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:52.079255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0311bb42-aec5-4441-9cc2-40be7a9f6d5f req-adc21e6d-edb0-4a7a-b81f-0285beb0a8a1 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.079747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0311bb42-aec5-4441-9cc2-40be7a9f6d5f req-adc21e6d-edb0-4a7a-b81f-0285beb0a8a1 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.095909 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-0311bb42-aec5-4441-9cc2-40be7a9f6d5f req-adc21e6d-edb0-4a7a-b81f-0285beb0a8a1 service nova] Creating event network-changed:b0920c8f-86db-4b0c-8e65-a7d5286779ee for instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d on hv-cinder-83979 May 27 19:50:52.097755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-0311bb42-aec5-4441-9cc2-40be7a9f6d5f req-adc21e6d-edb0-4a7a-b81f-0285beb0a8a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173547 May 27 19:50:52.098674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 42/90] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:52.113161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:52.113776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:52.122348 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.122784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.124336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.125292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.269190 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:52.269818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:52.270526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:52.277874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.278719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.279843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.280431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e1d9d61d-84c3-4d05-8fac-a2c0eb15c923 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.175310 May 27 19:50:52.280560 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.281681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 49/91] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:52 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:52.420114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:52.427825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-49bbead9-a14c-48f7-9513-b816f6869d01 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.162601 May 27 19:50:52.428401 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 43/92] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:52 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:52.478402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:52.479014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:52.485305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.485758 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.486557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:52.486997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:52.905385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:52.924171 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:52.926084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:52.928790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-701b8ca1-75f5-4d29-bdbc-71fafbae07b9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.454844 May 27 19:50:52.934373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 50/93] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:52 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:53.298169 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:53.298789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:53.305298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.306178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:53.307109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.307700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:53.444852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:53.445497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:53.455270 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.455956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:53.456926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.457609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:53.687460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:53.709649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4d5c3c02-92d5-4d0f-9287-b322f43ef52e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.401316 May 27 19:50:53.720313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 44/94] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:53 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:53.938383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:53.952354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:53.953232 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:53.961902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cf94024b-8d1f-45f1-afe0-941c9880af8d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.520732 May 27 19:50:53.965779 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.976562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 51/95] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:53 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:53.977929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:53.979051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:53.979648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:54.188333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:54.204439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:54.206208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:54.207513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e8ddec28-34a2-40c6-b8df-432e98b781c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.259572 May 27 19:50:54.208071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 45/96] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:53 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:50:54.728419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:54.730459 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:54.740680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:54.741980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:54.744039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:54.744687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:54.984691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:54.985949 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:54.998443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:54.999053 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:55.001708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:55.003684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:55.078724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:55.101403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b6262028-0bf1-4b65-913f-7f1ec1ec4e87 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.366889 May 27 19:50:55.101403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 52/97] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:54 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:55.227621 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:55.229410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:55.245236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:55.245236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:55.246158 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:55.246643 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:55.252074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:55.263688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-539a6758-5480-453a-b54a-dc08d3308665 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.282782 May 27 19:50:55.267580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 46/98] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:54 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:55.406849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-20ea4b0f-accc-4f40-972b-035fc893fbc0 req-565f37a3-20e7-4780-bbb3-902130fd9441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb10669a-44f0-4557-9139-37ea8c867ebc", "name": "network-vif-plugged", "status": "completed", "tag": "f7b06425-d7f4-43f7-9984-06401d17896b"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:50:55.416620 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-20ea4b0f-accc-4f40-972b-035fc893fbc0 req-565f37a3-20e7-4780-bbb3-902130fd9441 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:55.417530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-20ea4b0f-accc-4f40-972b-035fc893fbc0 req-565f37a3-20e7-4780-bbb3-902130fd9441 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:55.432011 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-20ea4b0f-accc-4f40-972b-035fc893fbc0 req-565f37a3-20e7-4780-bbb3-902130fd9441 service nova] Creating event network-vif-plugged:f7b06425-d7f4-43f7-9984-06401d17896b for instance bb10669a-44f0-4557-9139-37ea8c867ebc on hv-cinder-83979 May 27 19:50:55.437462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-20ea4b0f-accc-4f40-972b-035fc893fbc0 req-565f37a3-20e7-4780-bbb3-902130fd9441 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121820 May 27 19:50:55.438622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 47/99] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:50:55.466798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:55.477038 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:55.479149 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:55.480693 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-957188e3-e21e-474b-b550-caf1bbf8912c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.258695 May 27 19:50:55.481791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 53/100] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:55 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:56.116207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:56.118211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:56.124782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.125251 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.126012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.126472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.292433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:56.293898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:56.299296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:56.301471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.302141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.303110 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.303742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.309405 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0cacbd2b-bd0b-4c0f-a645-d0f5ca3e5ae0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.197519 May 27 19:50:56.309978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:56 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:56.504930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:56.511076 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:56.517343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.517897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.518692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:56.519195 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:56.585160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:56.599931 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a0b18bd2-f7e0-429e-9ad5-1d6b9908654d tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.318222 May 27 19:50:56.611132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 54/102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:56 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:50:56.818496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:56.828477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:56.830188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:56.831444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0d60ab48-6761-44b9-924c-a10f90850565 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.330507 May 27 19:50:56.832317 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 49/103] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:56 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:57.328585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:57.335488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:57.342957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.344032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.344971 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.345715 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.573102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:57.591300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3e424a15-0b28-4074-891b-59a5bb4e468c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.268001 May 27 19:50:57.592525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 55/104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:57 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:57.621494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:57.623342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:57.637503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.637950 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.642510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.642510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.855560 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:57.855560 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:57.860112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.860557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.861398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:57.861833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:57.989717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:57.999050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-55bcd64d-b3dd-4cf7-96c0-4354667a3ea7 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.383904 May 27 19:50:57.999757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 50/105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:57 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:58.007891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:58.017606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:58.019152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:58.020335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a548285d-dcb2-48de-950a-dfea7bdb02a3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.173938 May 27 19:50:58.020891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 56/106] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:57 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:58.608441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:58.609079 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:58.615600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:58.616222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:58.617295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:58.617634 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:58.621117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:58.792499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:58.802211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d8f323d4-0eea-4be0-9956-3e59171fc2c6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.197220 May 27 19:50:58.803171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 51/107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:58 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:59.016314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:59.017083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:59.023147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.023917 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.024866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.025425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.031430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:59.039542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:59.040272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:59.046654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.047340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.048280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.048862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.197963 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:59.206747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:59.208461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:59.209881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6bf68d48-281e-464f-9b71-d376cb09a28c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.175160 May 27 19:50:59.210487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 52/108] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:50:59 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:50:59.359948 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:59.368588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ecee6538-cd97-494f-8701-6993ca443241 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.356011 May 27 19:50:59.369564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:59 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:50:59.823570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:50:59.826026 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:50:59.835852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.837518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.838863 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:50:59.839543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:50:59.982828 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:50:59.990543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-46e9dce4-74b1-4958-85e6-7beb909bd144 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.175283 May 27 19:50:59.991110 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:50:59 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:00.228911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:00.229680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:00.236647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:00.237261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:00.238077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:00.238513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:00.373959 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:00.382382 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:00.384382 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:00.385526 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-29708ef5-2a78-4124-981e-ac0b4f31e442 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.160812 May 27 19:51:00.386082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 58/111] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:00 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:00.386854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:00.387483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:00.393850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:00.394359 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:00.395333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:00.395825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:00.535636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:00.543917 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fb35726f-f477-4bce-bc28-8800b0e86a5a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.161806 May 27 19:51:00.544796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 54/112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:00 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:01.007681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:01.009123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:01.011051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:01.016147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.016599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.017832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.017832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.151021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:01.158449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-51a1822e-faae-418c-b29a-b6ce6deff27c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.154670 May 27 19:51:01.159020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 59/113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:01 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:01.403393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:01.404030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:01.410086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.410537 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.411325 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.411758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.545180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:01.553249 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:01.554764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:01.556536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3670d0d6-4290-43b6-b195-f3508e03f51f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.156551 May 27 19:51:01.557337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 55/114] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:01 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:01.562048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:01.563030 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:01.568687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.569200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.569958 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:01.570397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:01.706865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:01.712117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-babc60c9-5b96-4a89-afbd-932ffe3bc83b tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.154172 May 27 19:51:01.712987 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 60/115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:01 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:02.175376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:02.176022 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:02.182771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.189348 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.189348 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.189667 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.347677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:02.355801 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-afc26654-2a8c-4f50-8bb2-9c44888739fc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.184119 May 27 19:51:02.356496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:02 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:02.574243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:02.574849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:02.580863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.581342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.582107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.582539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.713561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:02.722083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:02.723702 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:02.725105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-93726ed5-51c5-48be-9495-208554a72ce8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.154733 May 27 19:51:02.725829 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 61/117] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:02 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:02.736500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:02.737212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:02.743221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.743688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.744585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:02.745047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:02.886583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:02.894774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ec5ce604-3d11-4ca2-af9b-ac81a3b417a8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.169210 May 27 19:51:02.895409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:02 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:03.374628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:03.375291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:03.381863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.382315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:03.383083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.383518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:03.590265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:03.602316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9c0c967a-8012-495a-8f2f-29ab32fff91f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.232816 May 27 19:51:03.603914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 62/119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:03 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:03.743858 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:03.744459 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:03.750905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.751343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:03.752283 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.752715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:03.913244 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:03.918609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:03.919212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:03.922045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:03.924823 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:03.925352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.925801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:03.926029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b984d868-5509-4af5-a1a8-4648f3cae74c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.186668 May 27 19:51:03.926647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:03.926759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 58/120] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:03 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:03.927078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:04.137268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:04.145518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ec93ac0d-6cac-44a8-87da-0e0bd19ac9bf tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1314 microversion: 2.1 time: 0.231432 May 27 19:51:04.148060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 63/121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:03 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:04.483119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-b8450622-e36a-48b0-9f36-de6baae13bf7 req-ea01649c-7f90-43a3-bd41-a4a32a4de037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6870d2-0e10-4d9d-b00a-35b77afceb0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0920c8f-86db-4b0c-8e65-a7d5286779ee"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:04.497554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-b8450622-e36a-48b0-9f36-de6baae13bf7 req-ea01649c-7f90-43a3-bd41-a4a32a4de037 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:04.497554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-b8450622-e36a-48b0-9f36-de6baae13bf7 req-ea01649c-7f90-43a3-bd41-a4a32a4de037 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:04.504899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-b8450622-e36a-48b0-9f36-de6baae13bf7 req-ea01649c-7f90-43a3-bd41-a4a32a4de037 service nova] Creating event network-vif-plugged:b0920c8f-86db-4b0c-8e65-a7d5286779ee for instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d on hv-cinder-83979 May 27 19:51:04.513976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-b8450622-e36a-48b0-9f36-de6baae13bf7 req-ea01649c-7f90-43a3-bd41-a4a32a4de037 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 May 27 19:51:04.515286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 59/122] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:04.619660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:04.620371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:04.638892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:04.639398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:04.640186 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:04.646367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:04.795948 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:04.803697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2eedf476-bbd6-4c5d-a3b6-02e026395775 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.187892 May 27 19:51:04.815368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:04 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:04.960897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:04.960897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:04.960897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:04.960897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:04.961599 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:04.961599 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:05.108687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:05.117880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:05.119609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:05.120710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-53b7c1c1-ac69-4feb-a362-fac2c0bc6cdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.174237 May 27 19:51:05.121289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 60/124] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:04 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:05.172147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:05.172761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:05.178659 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:05.179101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:05.179857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:05.180286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:05.356163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:05.364242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e5e378db-70a4-4299-bc34-7cf27384271f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1502 microversion: 2.1 time: 0.195938 May 27 19:51:05.365003 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 65/125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:05 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:05.824035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:05.824825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:05.831907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:05.832787 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:05.833638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:05.834083 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:05.990709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:05.999980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c3bf628e-dad4-4690-97ed-ee26abf868a1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1366 microversion: 2.1 time: 0.181515 May 27 19:51:06.010570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 61/126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:05 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:06.140086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:06.140913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:06.148030 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:06.148483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:06.149409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:06.149845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:06.310355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:06.318561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:06.320135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:06.321495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-be0135cd-f5cf-4b7b-af23-8c8df059051c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.185854 May 27 19:51:06.322165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 66/127] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:06 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:06.529883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-8f17b0f8-da4a-47e3-8d37-839b086c2bb8 req-fcf691bb-eee1-4366-9c45-9b4623287bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:06.538791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8f17b0f8-da4a-47e3-8d37-839b086c2bb8 req-fcf691bb-eee1-4366-9c45-9b4623287bfe service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:06.541567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8f17b0f8-da4a-47e3-8d37-839b086c2bb8 req-fcf691bb-eee1-4366-9c45-9b4623287bfe service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:06.555171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-8f17b0f8-da4a-47e3-8d37-839b086c2bb8 req-fcf691bb-eee1-4366-9c45-9b4623287bfe service nova] Creating event network-vif-plugged:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:51:06.567065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-8f17b0f8-da4a-47e3-8d37-839b086c2bb8 req-fcf691bb-eee1-4366-9c45-9b4623287bfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040884 May 27 19:51:06.567736 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 62/128] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:07.017814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:07.018421 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:07.024457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.024902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.025748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.026159 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.174352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:07.182555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c0d277b2-d100-4cad-b9c8-6362010605be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1557 microversion: 2.1 time: 0.168720 May 27 19:51:07.183122 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 67/129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:07 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:07.204361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:07.205077 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:07.212625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.213415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.214354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.214726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.297095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5e48014-ebfa-4c8f-8341-39f8b64ec883"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:07.298327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:07.305118 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.305688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.306522 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.306956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.356941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8c0c76fb-5ac8-4331-aeeb-4379313f158e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156655 May 27 19:51:07.357475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 63/130] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:51:07 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:51:07.362298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:07.363309 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:07.372915 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.373866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.374878 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:07.375543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:07.600045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:07.610720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:07.612514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:07.613882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-789dc66f-b7be-49b4-ba58-298184d9f439 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.255428 May 27 19:51:07.614590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 64/131] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:07 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:08.535398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-859bd147-3e49-4213-b250-7cc9ac38bc11 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "POST /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.242198 May 27 19:51:08.537467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 68/132] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:51:07 2022] POST /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc/os-volume_attachments => generated 194 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:51:08.632716 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:08.634203 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:08.641499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:08.641947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:08.642946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:08.643536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:08.825184 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:08.839448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:08.841185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:08.842652 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c0b5bce8-1772-4bfe-b353-3da158eae348 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1407 microversion: 2.20 time: 0.214144 May 27 19:51:08.847208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 65/133] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:08 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:09.050968 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-872bf97f-b688-4ec4-a5e5-4939da057aed req-e0e4c0c4-8fe6-4de4-a0dc-3fd0552d16c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6870d2-0e10-4d9d-b00a-35b77afceb0d", "tag": "b0920c8f-86db-4b0c-8e65-a7d5286779ee"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:09.060579 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-872bf97f-b688-4ec4-a5e5-4939da057aed req-e0e4c0c4-8fe6-4de4-a0dc-3fd0552d16c6 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:09.061219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-872bf97f-b688-4ec4-a5e5-4939da057aed req-e0e4c0c4-8fe6-4de4-a0dc-3fd0552d16c6 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:09.073153 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-872bf97f-b688-4ec4-a5e5-4939da057aed req-e0e4c0c4-8fe6-4de4-a0dc-3fd0552d16c6 service nova] Creating event network-changed:b0920c8f-86db-4b0c-8e65-a7d5286779ee for instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d on hv-cinder-83979 May 27 19:51:09.078276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-872bf97f-b688-4ec4-a5e5-4939da057aed req-e0e4c0c4-8fe6-4de4-a0dc-3fd0552d16c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034110 May 27 19:51:09.081775 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 69/134] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:09.865149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:09.865865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:09.872367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:09.872813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:09.874058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:09.874670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:10.038419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:10.047842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:10.049454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:10.050671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9fbc4e94-5f9e-4ffc-9ac5-f3bacc3b7d83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1598 microversion: 2.20 time: 0.190837 May 27 19:51:10.051170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 66/135] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:51:09 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:51:10.075130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:10.075864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:10.083530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:10.083530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:10.084248 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:10.084677 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:10.354339 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7566fdb6-85f9-436d-be60-29d872efdb71 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.284094 May 27 19:51:10.363612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 70/136] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 19:51:10 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:51:11.917681 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-acd725ef-cb3b-4de5-924f-74aba49ef657 req-575eb940-780b-4d0f-b26f-e29326105f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:11.928057 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-acd725ef-cb3b-4de5-924f-74aba49ef657 req-575eb940-780b-4d0f-b26f-e29326105f3e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:11.928773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-acd725ef-cb3b-4de5-924f-74aba49ef657 req-575eb940-780b-4d0f-b26f-e29326105f3e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:12.088650 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-acd725ef-cb3b-4de5-924f-74aba49ef657 req-575eb940-780b-4d0f-b26f-e29326105f3e service nova] Creating event network-changed:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:51:12.093987 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-acd725ef-cb3b-4de5-924f-74aba49ef657 req-575eb940-780b-4d0f-b26f-e29326105f3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180877 May 27 19:51:12.095083 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 67/137] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:20.110449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=65 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:20.114468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:20.115135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:20.121819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:20.122437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:20.126848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:20.126848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:20.150267 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:51:20.268305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:20.458437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-246414c6-4706-4ed4-88ef-c73177b9203a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 204 len: 0 microversion: 2.1 time: 0.348847 May 27 19:51:20.470156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 71/138] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:51:20 2022] DELETE /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:51:20.470308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:20.470978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:20.473163 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=72 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:20.484790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:20.484790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:20.484790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:20.484790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:20.644389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:20.652927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a2b57046-25eb-4933-bd73-0e34403ea4a0 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1554 microversion: 2.1 time: 0.188720 May 27 19:51:20.653513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 68/139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:20 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:21.673452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:21.673452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:21.679515 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:21.679957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:21.680925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:21.681433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:21.821398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:21.829295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f125656b-a26f-45f1-bae2-6a2839e64ffd tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1554 microversion: 2.1 time: 0.162349 May 27 19:51:21.829854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 72/140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:21 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:22.847516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:22.848121 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:22.855316 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:22.855948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:22.856923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:22.857340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:23.114267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:23.126966 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4f42cf66-73b6-4b7f-b54e-c2ab2347652a tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1554 microversion: 2.1 time: 0.283373 May 27 19:51:23.128045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 69/141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:22 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1554 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:24.144018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:24.144686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:24.151827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:24.152266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:24.153045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:24.153479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:24.291002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:24.298957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3fa36622-23a5-47df-ad25-a5fb651e11cb tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1554 microversion: 2.1 time: 0.158717 May 27 19:51:24.299523 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:24 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:25.317924 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:25.318687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:25.325548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:25.325996 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:25.326928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:25.327534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:25.333390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:25.462233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:25.470706 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7ba48239-14ae-4356-88c4-a458db4bb0ff tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1554 microversion: 2.1 time: 0.156767 May 27 19:51:25.471477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 70/143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:25 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:26.491120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:26.494167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:26.512687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:26.513703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:26.514949 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:26.515598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:26.630590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-450ef2bd-2107-4039-914d-0e36b3a39836 req-a34693d9-b054-42ea-81b6-975a3e888f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb10669a-44f0-4557-9139-37ea8c867ebc", "name": "network-vif-deleted", "tag": "f7b06425-d7f4-43f7-9984-06401d17896b"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:26.650498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-450ef2bd-2107-4039-914d-0e36b3a39836 req-a34693d9-b054-42ea-81b6-975a3e888f98 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:26.651005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-450ef2bd-2107-4039-914d-0e36b3a39836 req-a34693d9-b054-42ea-81b6-975a3e888f98 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:26.669595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-450ef2bd-2107-4039-914d-0e36b3a39836 req-a34693d9-b054-42ea-81b6-975a3e888f98 service nova] Creating event network-vif-deleted:f7b06425-d7f4-43f7-9984-06401d17896b for instance bb10669a-44f0-4557-9139-37ea8c867ebc on hv-cinder-83979 May 27 19:51:26.675018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:26.679901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-450ef2bd-2107-4039-914d-0e36b3a39836 req-a34693d9-b054-42ea-81b6-975a3e888f98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049154 May 27 19:51:26.679901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 71/144] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:51:26.687640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6b6e7773-f610-4efb-9108-ee7a86799ed8 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1512 microversion: 2.1 time: 0.199617 May 27 19:51:26.694146 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 74/145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:26 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:27.701850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:27.702762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:27.708944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:27.709442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:27.710317 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:27.710770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:27.755841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:27.755841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:27.755841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lazy-loading 'fault' on Instance uuid bb10669a-44f0-4557-9139-37ea8c867ebc {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:51:27.804390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10369664f1914c51893eef1929b7d26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4362059e243479193d5a02e2e5611a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:27.812679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e5c35cef-2a91-4ce1-b85e-eae6e09f0163 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 200 len: 1350 microversion: 2.1 time: 0.115113 May 27 19:51:27.813422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 72/146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:27 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:28.830171 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:28.830782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:28.838265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:28.838717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:28.839487 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:28.840104 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:28.854295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] HTTP exception thrown: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Request method failure captured: May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc HTTP/1.1 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt4L0rkJ9-liNVyG4LCHcPxvh1w3DhY1810ianjK2n4uq2AebIeCS_tQcmO5XICk0ie6YSI-MKyySBIkgcyD2SuWaWXltgKCXg4mPjWyu84a9OywYPi4RpfH5mj-xwIU5Pesl8CezaPLkEvbN1T5PQiwjJim64PWfvAJ_VCJ6ltyAc May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:51:28.862711 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4362059e243479193d5a02e2e5611a1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4362059e243479193d5a02e2e5611a1"}]}] May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-DeleteServersTestJSON-308406518 May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 10369664f1914c51893eef1929b7d26b May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:28.864024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'bb10669a-44f0-4557-9139-37ea8c867ebc'} May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:51:28.864861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:28.868555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:28.870045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Returning 404 to user: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:51:28.870045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d897200e-e8a0-4d69-a245-78ff474381f1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 404 len: 111 microversion: 2.1 time: 0.038033 May 27 19:51:28.870045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 75/147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:28 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:51:28.981580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:28.982666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:28.988593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:28.989065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:28.989825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:28.990258 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:29.003817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] HTTP exception thrown: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Request method failure captured: May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc/os-volume_attachments HTTP/1.1 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt4L0rkJ9-liNVyG4LCHcPxvh1w3DhY1810ianjK2n4uq2AebIeCS_tQcmO5XICk0ie6YSI-MKyySBIkgcyD2SuWaWXltgKCXg4mPjWyu84a9OywYPi4RpfH5mj-xwIU5Pesl8CezaPLkEvbN1T5PQiwjJim64PWfvAJ_VCJ6ltyAc May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:51:29.007783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4362059e243479193d5a02e2e5611a1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4362059e243479193d5a02e2e5611a1"}]}] May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-DeleteServersTestJSON-308406518 May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 10369664f1914c51893eef1929b7d26b May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:29.009530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'server_id': 'bb10669a-44f0-4557-9139-37ea8c867ebc'} May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:51:29.011226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:29.012508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:29.013743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Returning 404 to user: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:51:29.013743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f8dfd52d-985d-4709-8ca3-bc824c2c8c4f tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031937 May 27 19:51:29.013743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:51:28 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:51:30.376619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:30.377158 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:30.384460 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:30.385060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:30.386435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:30.387039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:30.401463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] HTTP exception thrown: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Request method failure captured: May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: DELETE /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc HTTP/1.1 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt4L0rkJ9-liNVyG4LCHcPxvh1w3DhY1810ianjK2n4uq2AebIeCS_tQcmO5XICk0ie6YSI-MKyySBIkgcyD2SuWaWXltgKCXg4mPjWyu84a9OywYPi4RpfH5mj-xwIU5Pesl8CezaPLkEvbN1T5PQiwjJim64PWfvAJ_VCJ6ltyAc May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:51:30.403001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4362059e243479193d5a02e2e5611a1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4362059e243479193d5a02e2e5611a1"}]}] May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 10369664f1914c51893eef1929b7d26b May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.404313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'bb10669a-44f0-4557-9139-37ea8c867ebc'} May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:51:30.405092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.406185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:51:30.407316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Returning 404 to user: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:51:30.407316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-30b53424-8509-478a-bed6-d6ca544deee1 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 404 len: 111 microversion: 2.1 time: 0.031528 May 27 19:51:30.407316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 76/149] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:51:30 2022] DELETE /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:51:30.412889 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:30.413519 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] [instance: bb10669a-44f0-4557-9139-37ea8c867ebc] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:30.419729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:30.420362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:30.421333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:30.421769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:30.436659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] HTTP exception thrown: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Request method failure captured: May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc HTTP/1.1 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt4L0rkJ9-liNVyG4LCHcPxvh1w3DhY1810ianjK2n4uq2AebIeCS_tQcmO5XICk0ie6YSI-MKyySBIkgcyD2SuWaWXltgKCXg4mPjWyu84a9OywYPi4RpfH5mj-xwIU5Pesl8CezaPLkEvbN1T5PQiwjJim64PWfvAJ_VCJ6ltyAc May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:51:30.438792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4362059e243479193d5a02e2e5611a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4362059e243479193d5a02e2e5611a1", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4362059e243479193d5a02e2e5611a1"}]}] May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c4362059e243479193d5a02e2e5611a1 May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-DeleteServersTestJSON-308406518 May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 10369664f1914c51893eef1929b7d26b May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-DeleteServersTestJSON-308406518-project May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.440237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'bb10669a-44f0-4557-9139-37ea8c867ebc'} May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:51:30.441025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. May 27 19:51:30.442147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:51:30.443423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] Returning 404 to user: Instance bb10669a-44f0-4557-9139-37ea8c867ebc could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:51:30.443423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-830b47f6-518d-4eae-9698-f7b2aabbdd17 tempest-DeleteServersTestJSON-308406518 tempest-DeleteServersTestJSON-308406518-project] 10.222.0.13 "GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc" status: 404 len: 111 microversion: 2.1 time: 0.031130 May 27 19:51:30.443423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 74/150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:30 2022] GET /compute/v2.1/servers/bb10669a-44f0-4557-9139-37ea8c867ebc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:51:41.789252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:41.789859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=22 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:41.931712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1583600931", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:42.059310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] validate_networks() for [('e40ccd07-4997-4327-b6e0-646e8d04a640', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:51:43.323896 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:51:43.324665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:51:43.324806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:51:43.325245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:51:43.330556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:51:43.342488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:43.354665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:43.355760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:43.356424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:43.396875 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:51:43.413730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for user a13d2c50c5204c859872e99bc45c6566 and project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:51:43.421597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:51:43.424779 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:51:43.786088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-48846a6e-ce5d-4fbc-a83a-7b06c15df67d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.002556 May 27 19:51:43.789505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 77/151] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:51:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:51:43.799902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e02247d7-0ee2-4e19-92a0-025b42384cbe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:43.804208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e02247d7-0ee2-4e19-92a0-025b42384cbe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:43.816985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=15 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:43.817781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=19 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:43.917812 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e02247d7-0ee2-4e19-92a0-025b42384cbe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:43.927032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e02247d7-0ee2-4e19-92a0-025b42384cbe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1222 microversion: 2.1 time: 0.132222 May 27 19:51:43.929113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 75/152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:43 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:44.157954 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1020100684", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:44.217475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] validate_networks() for [('e40ccd07-4997-4327-b6e0-646e8d04a640', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:51:44.832927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:51:44.832927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:51:44.833613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:51:44.833705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:51:44.834226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:51:44.848871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:44.849373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:44.850239 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:44.850651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:44.921772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:51:44.926187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for user a13d2c50c5204c859872e99bc45c6566 and project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:51:44.956477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:51:44.962617 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:51:45.188034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6023db64-5017-4a7e-b74e-cca6a404300b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.035578 May 27 19:51:45.189767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 78/153] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:51:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:51:45.209478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a545e34f-6b4f-4632-9e75-b691522aff1d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:45.209927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a545e34f-6b4f-4632-9e75-b691522aff1d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:45.315837 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a545e34f-6b4f-4632-9e75-b691522aff1d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:45.335282 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a545e34f-6b4f-4632-9e75-b691522aff1d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1222 microversion: 2.1 time: 0.138168 May 27 19:51:45.340522 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 76/154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:45 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:46.356003 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5c62b91f-80d2-45d0-9afe-c095d7e15d31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:46.357204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5c62b91f-80d2-45d0-9afe-c095d7e15d31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:46.474668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5c62b91f-80d2-45d0-9afe-c095d7e15d31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:46.483522 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5c62b91f-80d2-45d0-9afe-c095d7e15d31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1222 microversion: 2.1 time: 0.130841 May 27 19:51:46.483522 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 79/155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:46 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:47.500348 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:47.500985 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:47.511960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:47.515518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:47.516833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:47.517928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:47.858952 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:47.871554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-27c2059c-00d8-44fb-a274-f11a64aa826d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1274 microversion: 2.1 time: 0.376747 May 27 19:51:47.875724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 77/156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:47 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:48.893406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:48.894674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:48.912088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:48.914988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:48.915857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:48.916299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:49.060854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:49.074722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5d8e4b3a-5289-4f42-879b-da4c6ac343e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1280 microversion: 2.1 time: 0.186391 May 27 19:51:49.086737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 80/157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:48 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:50.095903 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:50.099940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:50.108075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:50.125372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:50.131763 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:50.132750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:50.404044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:50.419208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5466245e-e5dc-41bb-bde3-afa15c3be898 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1280 microversion: 2.1 time: 0.324824 May 27 19:51:50.420006 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 78/158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:50 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1280 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:51.438014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:51.439322 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:51.450525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:51.451752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:51.452767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:51.453476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:51.811913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:51.826053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f824c47c-5d66-4906-b448-e2fd8a50d28f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.393350 May 27 19:51:51.828363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 81/159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:51 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:52.852440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:52.859076 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:52.894899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:52.896100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:52.898369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:52.899978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:52.996461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3e0e0167-c1cb-454a-95f6-5cac5ae59a48 req-bc2b76ba-4786-4761-a148-d1f3f1a033cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d81fcd54-4eed-417b-bd06-11187de21f7d", "tag": "8ec277e7-3677-43e5-ba4a-31b5be9f2cf4"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:53.039200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3e0e0167-c1cb-454a-95f6-5cac5ae59a48 req-bc2b76ba-4786-4761-a148-d1f3f1a033cc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:53.058863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3e0e0167-c1cb-454a-95f6-5cac5ae59a48 req-bc2b76ba-4786-4761-a148-d1f3f1a033cc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:53.133002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3e0e0167-c1cb-454a-95f6-5cac5ae59a48 req-bc2b76ba-4786-4761-a148-d1f3f1a033cc service nova] Creating event network-changed:8ec277e7-3677-43e5-ba4a-31b5be9f2cf4 for instance d81fcd54-4eed-417b-bd06-11187de21f7d on hv-cinder-83979 May 27 19:51:53.143261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3e0e0167-c1cb-454a-95f6-5cac5ae59a48 req-bc2b76ba-4786-4761-a148-d1f3f1a033cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158037 May 27 19:51:53.145726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 82/160] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:53.364368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:53.369848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-2e234210-da14-4f57-97d4-aec615026472 req-649cbc29-05b7-45d1-b0dc-36813992d22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2834017-00c4-4b0f-a2c0-88834cf9e767", "tag": "490504e7-47c9-436f-ae03-1488bb94a341"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:53.379803 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-39ec927a-6bb3-4c74-a78b-680e1fb30097 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.536983 May 27 19:51:53.380383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 79/161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:52 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:51:53.391335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-2e234210-da14-4f57-97d4-aec615026472 req-649cbc29-05b7-45d1-b0dc-36813992d22c service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:53.393997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-2e234210-da14-4f57-97d4-aec615026472 req-649cbc29-05b7-45d1-b0dc-36813992d22c service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:53.408585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-2e234210-da14-4f57-97d4-aec615026472 req-649cbc29-05b7-45d1-b0dc-36813992d22c service nova] Creating event network-changed:490504e7-47c9-436f-ae03-1488bb94a341 for instance d2834017-00c4-4b0f-a2c0-88834cf9e767 on hv-cinder-83979 May 27 19:51:53.428928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-2e234210-da14-4f57-97d4-aec615026472 req-649cbc29-05b7-45d1-b0dc-36813992d22c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076067 May 27 19:51:53.429754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 83/162] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:51:54.398176 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:54.398923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:54.412000 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:54.412721 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:54.413845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:54.414502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:54.714932 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:54.725800 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f2b1a9b4-d04a-4d5b-9d0a-50e41892a5a1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.331778 May 27 19:51:54.737335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 80/163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:54 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:54.740011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:54.740598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:54.752678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:54.753196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:54.754206 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:54.754867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:54.807375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6886015c-8494-4a98-a5cc-42dfd677d16a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/ips" status: 200 len: 151 microversion: 2.1 time: 0.072209 May 27 19:51:54.808553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 84/164] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:51:54 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/ips => generated 151 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:51:55.448318 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:55.449514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:55.454989 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:55.466222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:55.469242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:55.469242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:55.470508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:55.552212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2e763214-88d6-479d-a2c4-e6d1d43e2201 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/ips" status: 200 len: 151 microversion: 2.20 time: 0.109214 May 27 19:51:55.555265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 81/165] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 27 19:51:55 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/ips => generated 151 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:51:55.746392 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:55.747824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:55.759061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:55.771592 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:55.772258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:55.776266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:55.778949 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:56.140896 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:56.155139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0c785b47-385a-4f16-aaf7-dd0f03327c8c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.409729 May 27 19:51:56.165547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 85/166] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:55 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:57.171950 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:57.172696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:57.182413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:57.182666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:57.201588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:57.202050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:57.498477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:57.510582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7d68e95e-67ab-4b37-8bc7-c58ec729009d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.339216 May 27 19:51:57.513756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 82/167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:57 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:57.531229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4ed7997-d1ab-4b47-a6d9-21e9cf522267"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:57.533646 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:57.537116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=14 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:57.571786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:57.573443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:57.576192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:57.578127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:58.531343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:58.531957 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:58.538875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:58.549289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:58.552300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:58.552300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:58.760986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d006abd6-0451-47ed-9560-996a9d5268eb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.231555 May 27 19:51:58.760986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 86/168] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:51:57 2022] POST /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments => generated 194 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:51:58.823865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:51:58.825189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:58.848367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:58.848846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:58.852514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:58.852994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:58.924050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:51:58.926759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lazy-loading 'flavor' on Instance uuid 59595754-b21e-43c4-a3bd-2d0cd810a8d7 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:51:58.939514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f0a2b723-53e4-4dca-844a-107805f24d2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.412175 May 27 19:51:58.948993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 83/169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:58 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:51:59.956539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:51:59.958085 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:51:59.972285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:59.974188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:51:59.975374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:51:59.976939 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:00.107604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-762ac900-4404-48de-b4d7-e907733e8b55 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/action" status: 202 len: 0 microversion: 2.20 time: 1.288821 May 27 19:52:00.115332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 87/170] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 19:51:58 2022] POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/action => generated 0 bytes in 1297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 19:52:00.130669 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:00.145129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:00.162013 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:00.163265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:00.165427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:00.166084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:00.417091 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:00.425311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3382997c-be47-476d-84d8-673d32dddac2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.473147 May 27 19:52:00.427533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 84/171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:51:59 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:00.440971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-1a601a7a-a7ce-4cd9-a357-dc73ca48a04a req-48dbbde7-4954-49bf-88e6-c7569c1b6f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2834017-00c4-4b0f-a2c0-88834cf9e767", "name": "network-vif-plugged", "status": "completed", "tag": "490504e7-47c9-436f-ae03-1488bb94a341"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:00.455157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-1a601a7a-a7ce-4cd9-a357-dc73ca48a04a req-48dbbde7-4954-49bf-88e6-c7569c1b6f24 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:00.455860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-1a601a7a-a7ce-4cd9-a357-dc73ca48a04a req-48dbbde7-4954-49bf-88e6-c7569c1b6f24 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:00.499367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-1a601a7a-a7ce-4cd9-a357-dc73ca48a04a req-48dbbde7-4954-49bf-88e6-c7569c1b6f24 service nova] Creating event network-vif-plugged:490504e7-47c9-436f-ae03-1488bb94a341 for instance d2834017-00c4-4b0f-a2c0-88834cf9e767 on hv-cinder-83979 May 27 19:52:00.500160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:00.510586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-1a601a7a-a7ce-4cd9-a357-dc73ca48a04a req-48dbbde7-4954-49bf-88e6-c7569c1b6f24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081572 May 27 19:52:00.513094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 85/172] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:00.521597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:00.523895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:00.525136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5cf48371-d119-4673-b3d7-f302b631a060 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.407782 May 27 19:52:00.525857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 88/173] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:00 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:01.447715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:01.449104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:01.455645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:01.456120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:01.456912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:01.457410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:01.551714 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:01.552484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:01.559658 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:01.560107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:01.560872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:01.561332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:01.596137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:01.605092 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-12b8a849-a3ee-455f-9ede-fe8240bb3061 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.164722 May 27 19:52:01.605674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 86/174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:01 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:01.694491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:01.723208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:01.724795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:01.731688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6cd100ea-3010-4e23-8fe2-a9b564855dec tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.179519 May 27 19:52:01.731688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 89/175] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:01 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:02.527639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-e17c5aa5-d929-46df-af6a-18391fd835d2 req-e99f68e9-f593-4224-a18a-7285f7df3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fcd54-4eed-417b-bd06-11187de21f7d", "name": "network-vif-plugged", "status": "completed", "tag": "8ec277e7-3677-43e5-ba4a-31b5be9f2cf4"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:02.545732 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-e17c5aa5-d929-46df-af6a-18391fd835d2 req-e99f68e9-f593-4224-a18a-7285f7df3f41 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:02.549277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-e17c5aa5-d929-46df-af6a-18391fd835d2 req-e99f68e9-f593-4224-a18a-7285f7df3f41 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:02.579606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-e17c5aa5-d929-46df-af6a-18391fd835d2 req-e99f68e9-f593-4224-a18a-7285f7df3f41 service nova] Creating event network-vif-plugged:8ec277e7-3677-43e5-ba4a-31b5be9f2cf4 for instance d81fcd54-4eed-417b-bd06-11187de21f7d on hv-cinder-83979 May 27 19:52:02.585546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-e17c5aa5-d929-46df-af6a-18391fd835d2 req-e99f68e9-f593-4224-a18a-7285f7df3f41 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061768 May 27 19:52:02.590077 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 87/176] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:02.622401 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:02.625256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:02.637389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:02.637839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:02.638630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:02.639690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:02.763789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:02.764557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:02.784764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:02.788025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:02.792583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:02.792583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:02.911276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:02.925774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0cc46b4c-a09a-4e4b-9d10-40627f74be42 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1322 microversion: 2.1 time: 0.307498 May 27 19:52:02.927029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:02 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:03.372503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:03.385100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:03.386738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:03.390613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5729c3db-b05c-4011-940c-45c0f405394f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.641544 May 27 19:52:03.403910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 88/178] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:02 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:03.953498 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:03.955268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:03.972223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:03.976071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:03.981240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:03.981240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.173425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:04.183727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dcf1fb6f-22e9-490e-874f-21ca9a098abe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1516 microversion: 2.1 time: 0.243429 May 27 19:52:04.187417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 91/179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:03 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:04.203709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:04.214662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:04.226234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.228631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.229700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.230360 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.298253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'flavor' on Instance uuid d2834017-00c4-4b0f-a2c0-88834cf9e767 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:52:04.410008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:04.418697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:04.421626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.422016 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.422787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.423229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.685073 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:04.694467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:04.699284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:04.701683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2436267a-9b30-4dbe-8b69-2d257371a74d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.296153 May 27 19:52:04.702476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 92/180] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:04 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:04.751417 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-52bda271-42ef-4416-8c88-ffe8bbfc75ca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767/action" status: 200 len: 32 microversion: 2.1 time: 0.551739 May 27 19:52:04.756074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 89/181] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:52:04 2022] POST /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767/action => generated 32 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 19:52:04.765014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:04.765861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:04.775337 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.777181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:04.779413 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:04.781622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:05.080374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:05.093937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-15f61ce8-7c70-4179-8d32-1778f51ed7e4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.333338 May 27 19:52:05.105577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:04 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:05.722144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:05.722785 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:05.735474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:05.735918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:05.737968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:05.739478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:05.983828 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:06.017087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:06.023876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:06.027896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c0563f22-6b2b-41c4-8a93-4b6f29ee5fb1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.311820 May 27 19:52:06.043511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 90/183] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:05 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:06.112002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:06.113656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:06.130806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:06.134969 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:06.134969 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:06.135226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:06.178097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:06.850647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:06.860360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f0fc9020-0989-4c68-9ea2-cd9d4a004138 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.752641 May 27 19:52:06.861468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 94/184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:06 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:07.054679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:07.055643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:07.061941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:07.064749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:07.064749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:07.064749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:07.216199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d98e3b0f-9b81-4def-a566-ac1d1661c594 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: .version_select at 0x7fe1b4aaf9d0>, body: {"keypair": {"name": "tempest-keypair-1352313183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFLZ2JI5bLA4LxEK7T3TPP5I51/V7Zw0jaIWs03+Vr/YZetS5bzbTw52aiiiMwOpDhxiZ7qLe25KNkI1S3+Nn1tKKFshsvm1EsFcjALxNE9DUL6UTJsflnC2duDVOaB1w=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:07.249810 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-d98e3b0f-9b81-4def-a566-ac1d1661c594 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:07.261224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-d98e3b0f-9b81-4def-a566-ac1d1661c594 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:07.293064 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:07.302230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:07.308513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:07.310157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9276e377-f3b6-43c0-b2b2-b68d19d3133a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.260836 May 27 19:52:07.311875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 91/185] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:07 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:07.472871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d98e3b0f-9b81-4def-a566-ac1d1661c594 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.260471 May 27 19:52:07.479344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 95/186] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:52:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:52:07.880534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:07.881761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:07.891133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:07.891580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:07.904533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:07.904533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:08.120516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:08.137923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0d14456e-2929-42a4-bc25-2a74be7070e1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.263788 May 27 19:52:08.138821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 92/187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:07 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:08.329673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:08.330892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:08.356628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:08.357355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:08.358309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:08.358904 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:08.549306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:08.557230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:08.566371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:08.567911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0d8a17f6-ae1f-4c45-b9b8-7e9f76efbe58 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.243543 May 27 19:52:08.571337 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 96/188] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:08 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:09.160914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:09.162166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:09.176945 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:09.177798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:09.179070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:09.179842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:09.190557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:09.540277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:09.558342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-612ab4dd-93bd-4855-b503-72462b00ed57 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.406479 May 27 19:52:09.559861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 93/189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:09 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:09.590549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:09.591227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:09.615660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:09.619291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:09.620845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:09.621920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:09.824117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:09.832423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:09.834375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:09.842891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e42a51b8-5b87-4c83-9ee7-3e849652d59c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.250677 May 27 19:52:09.842891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 97/190] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:09 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:10.010591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-878067589", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "networks": [{"uuid": "fc05afcc-37bd-43c8-b1dc-0dfa370b7d83"}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:10.580650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:10.581650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:10.589717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:10.590532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:10.591391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:10.592453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:10.781911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:10.791437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2f67c0b1-bde6-42fa-bdcc-37e0ad24108f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.216332 May 27 19:52:10.795344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 98/191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:10 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:10.858616 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:10.859355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:10.873024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:10.874113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:10.874907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:10.875497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:11.087715 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:11.096544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:11.098468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:11.100097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-973fb193-41ef-4ac6-a5bb-013a7deb902a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.245485 May 27 19:52:11.100970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 99/192] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:10 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:11.115344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-249131195", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc686edf-9590-4ae1-ab4c-4d4524b126ab"}], "security_groups": [{"name": "tempest-securitygroup--1714274389"}], "key_name": "tempest-keypair-1352313183", "user_data": "}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:12.984036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] validate_networks() for [('fc05afcc-37bd-43c8-b1dc-0dfa370b7d83', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:52:13.048096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] validate_networks() for [('dc686edf-9590-4ae1-ab4c-4d4524b126ab', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:52:13.371547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:52:13.371976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:52:13.372444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:52:13.372849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:52:13.373295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:52:13.383030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.383487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.384267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.384692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.402876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Getting quotas for project 729158c0db83438a9b762aae3f0009a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:13.406895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Getting quotas for user 83d3494760b84bc1aad951bba11caea3 and project 729158c0db83438a9b762aae3f0009a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:13.419438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:52:13.421935 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:52:13.467835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:52:13.468518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:52:13.469051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:52:13.469558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:52:13.469979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:52:13.479371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.479821 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.480686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.481165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.503497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:13.511414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:13.519815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:13.522763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:52:13.525067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:52:13.624865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f7948aae-de22-47e9-83ab-19822ebb890f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.619132 May 27 19:52:13.626437 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 94/193] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:52:13.632829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:13.633671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:13.647913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.648465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.649587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.650194 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.691924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cf031cd7-519f-4fb6-8fd8-377901280014 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.589610 May 27 19:52:13.692671 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 100/194] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:52:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:52:13.697770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:13.698666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:13.706446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.707091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.708254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:13.708839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:13.837513 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:13.848992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-120312a5-907a-43be-9462-912d1a5277d9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.221202 May 27 19:52:13.851748 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 95/195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:13 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:13.865182 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-558298f6-9578-4279-94c3-26fbd59574c0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'create', calling method: .version_select at 0x7fe1b4a70940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1632819889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA3xXuutifhAjgUsUifqW3HLqRa2BnAUIu/9l+RXLgJ90JnQL51SRHcPP0NgC1azetfFfTQ/1t7eyv5xW53pw2qaKmJaYq8wCPOKrICnb101X0uC8W00BQMuP2VglyYLA=="}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:13.889183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-558298f6-9578-4279-94c3-26fbd59574c0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Getting quotas for project 0ca4fe16a0204d0db4289e293771581b. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:13.895003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-558298f6-9578-4279-94c3-26fbd59574c0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Getting quotas for user c0f12003099f4f80bb89c2a335d231ca and project 0ca4fe16a0204d0db4289e293771581b. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:13.941082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:13.950265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:13.951911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:13.953115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2cad44a0-6750-4830-bc12-30152ea62e0f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.259238 May 27 19:52:13.953670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 101/196] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:13 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:13.958069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-15fcc170-8825-459d-9ea5-bf855f583a50 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:13.964877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-15fcc170-8825-459d-9ea5-bf855f583a50 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:14.026840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-15fcc170-8825-459d-9ea5-bf855f583a50 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:14.033393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-558298f6-9578-4279-94c3-26fbd59574c0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.180309 May 27 19:52:14.037841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 96/197] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:52:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:14.039498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6277905c-4dd4-4bf1-a6a0-186f34155d23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:14.040247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6277905c-4dd4-4bf1-a6a0-186f34155d23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:14.042500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-15fcc170-8825-459d-9ea5-bf855f583a50 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1213 microversion: 2.1 time: 0.086329 May 27 19:52:14.042500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 102/198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:13 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:14.106999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6277905c-4dd4-4bf1-a6a0-186f34155d23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:14.114211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6277905c-4dd4-4bf1-a6a0-186f34155d23 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1241 microversion: 2.1 time: 0.079216 May 27 19:52:14.114772 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 97/199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:14 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:14.151855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-808376762", "imageRef": "7efa177a-f93a-4c5b-961e-53680f582080", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1632819889", "networks": [{"uuid": "1406cf43-7604-4d11-b1fb-dfaadf027c40"}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:14.205942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] validate_networks() for [('1406cf43-7604-4d11-b1fb-dfaadf027c40', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:52:14.615355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:52:14.615911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:52:14.616731 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:52:14.622081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:52:14.622081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:52:14.627495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:14.627937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:14.628817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:14.629300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:14.650397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Getting quotas for project 0ca4fe16a0204d0db4289e293771581b. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:14.652012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Getting quotas for user c0f12003099f4f80bb89c2a335d231ca and project 0ca4fe16a0204d0db4289e293771581b. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:14.662885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:52:14.664935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7efa177a-f93a-4c5b-961e-53680f582080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:52:14.869402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-92e86f2e-cb8d-47aa-ae5e-bf958fb3f49f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721791 May 27 19:52:14.870152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 103/200] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:52:14.874947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:14.875778 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:14.880609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-446da9d2-1a44-4039-b4b5-89d7cc8382f5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:14.882291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-446da9d2-1a44-4039-b4b5-89d7cc8382f5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:14.894492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:14.895560 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:14.896525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:14.900315 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:14.984567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-446da9d2-1a44-4039-b4b5-89d7cc8382f5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:14.992222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-446da9d2-1a44-4039-b4b5-89d7cc8382f5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1258 microversion: 2.1 time: 0.116033 May 27 19:52:14.992792 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 104/201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:14 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1258 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:15.018648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:15.019264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:15.034883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.035557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.036712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.038017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.071914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.078579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0d971d13-3c56-4bd3-aaec-5d911815f01b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.214692 May 27 19:52:15.079153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 98/202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:14 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:15.084611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:15.085760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:15.105672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.105672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.105672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.105672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.172827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.187628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5ad73e05-d522-4504-9828-6eb29ffe2610 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1217 microversion: 2.1 time: 0.107036 May 27 19:52:15.189368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 99/203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:15 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:15.196221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:15.196841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:15.203117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.203572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.208792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:15.208792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:15.222610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.239166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.240932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.243729 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8b733346-28d2-49fa-ba68-f7fc53729cc0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.248463 May 27 19:52:15.243729 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 105/204] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:14 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:15.275480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:15.286486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2fbbe5a9-79a3-42ca-a1f4-9ee4adb966f1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1245 microversion: 2.1 time: 0.095895 May 27 19:52:15.287054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 100/205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:15 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:16.010384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8492add2-ffb0-4728-9a49-9fe10de44dfd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:16.010999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8492add2-ffb0-4728-9a49-9fe10de44dfd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:16.072429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8492add2-ffb0-4728-9a49-9fe10de44dfd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.079294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8492add2-ffb0-4728-9a49-9fe10de44dfd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1258 microversion: 2.1 time: 0.073757 May 27 19:52:16.079984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 106/206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:16 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:16.095797 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:16.096459 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:16.098872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:16.103926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.104376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.105168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.105695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.210072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:16.211117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:16.218341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.218873 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.219721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.220231 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.283932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.290805 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.291880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f8d03b61-8418-4a19-97be-291540ecfd53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1265 microversion: 2.1 time: 0.085855 May 27 19:52:16.293121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 107/207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:16 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:16.298536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:16.299332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:16.300829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a1531f65-caf9-46d8-a231-89d8518aca97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.209073 May 27 19:52:16.301530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 101/208] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:16 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:16.307455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.307625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:16.308246 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:16.308423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.309194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.309683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.314393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.315075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.315915 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:16.316446 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:16.381058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.390393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dc38d646-10ca-4f58-8bdc-9f856b314a31 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1293 microversion: 2.1 time: 0.087712 May 27 19:52:16.391452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 102/209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:16 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:16.458316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.466841 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.468718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:16.469914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-82e6020a-5e97-4ed3-aa17-da0c13d14fdd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1744 microversion: 2.20 time: 0.175673 May 27 19:52:16.470478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 108/210] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:16 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:17.098663 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:17.100041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:17.108575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.110493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.111637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.112342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.269305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.279143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1c47b44d-b3ce-4f8f-9f61-1727a93d2e5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1254 microversion: 2.1 time: 0.185750 May 27 19:52:17.286825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 103/211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:17 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1254 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:17.309454 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:17.310049 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:17.322153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:17.329815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:17.346656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.352719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.354852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.355862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.356303 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.361357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.362378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.369572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.583202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.595442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5c6684c2-9601-4280-85e2-3567522e328e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.277273 May 27 19:52:17.601937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 104/212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:17 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:17.607228 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:17.607834 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:17.614071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.614443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.615200 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.615798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.617940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.632622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-63e753c8-59c5-4e85-a172-ec291bceb759 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1273 microversion: 2.1 time: 0.325627 May 27 19:52:17.635306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 109/213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:17 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1273 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:17.654167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:17.656300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:17.668880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.672558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.672558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:17.672558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:17.689614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.699189 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-933fe3a8-2375-4f9f-8ea4-1af5939c887e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1299 microversion: 2.1 time: 0.095754 May 27 19:52:17.699771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 105/214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:17 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:17.958786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.978118 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.981538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:17.984180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8f8b9d0a-08fd-44c2-98ee-27eef8468ef6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1744 microversion: 2.20 time: 0.336369 May 27 19:52:17.986752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 110/215] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:17 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1744 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:18.302068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:18.303354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:18.310219 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.311033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.311672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.312174 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.433176 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:18.449295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-60cde66e-f560-4cb2-9f5e-61bcf95bc476 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1254 microversion: 2.1 time: 0.151151 May 27 19:52:18.449885 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 106/216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:18 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1254 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:18.610061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:18.610660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:18.619069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.620128 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.620906 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.621361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.654944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:18.654944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:18.665850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.668717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.675908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.676884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.846690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:18.856010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b911feac-897d-4504-81de-4f9730d8ecb9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.250100 May 27 19:52:18.860578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 111/217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:18 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:18.875888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:18.876538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:18.876792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:18.884459 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.884904 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.885218 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-cf423cb5-e925-4004-b094-6f53487cdb27 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.235500 May 27 19:52:18.888163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:18.888790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:18.894786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 107/218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:18 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:19.004045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:19.004776 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:19.011791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.012237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.013195 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.013633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.216570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:19.232442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:19.234344 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:19.235755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d2feb0e7-3c31-46de-99a8-008e5d9d583a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1744 microversion: 2.20 time: 0.235866 May 27 19:52:19.236792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 108/219] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:18 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:19.297339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-eb4f1cc8-5d33-4623-8f38-2d38f22a0a51 req-febb1433-eac6-40d8-b87e-a770ae159b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:19.314933 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-eb4f1cc8-5d33-4623-8f38-2d38f22a0a51 req-febb1433-eac6-40d8-b87e-a770ae159b99 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.316226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-eb4f1cc8-5d33-4623-8f38-2d38f22a0a51 req-febb1433-eac6-40d8-b87e-a770ae159b99 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.344466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-eb4f1cc8-5d33-4623-8f38-2d38f22a0a51 req-febb1433-eac6-40d8-b87e-a770ae159b99 service nova] Creating event network-vif-plugged:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:52:19.354065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-eb4f1cc8-5d33-4623-8f38-2d38f22a0a51 req-febb1433-eac6-40d8-b87e-a770ae159b99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061198 May 27 19:52:19.356415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 109/220] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:19.406247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:19.414341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2eb566d9-f747-44ec-acc7-06be905bfcc1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.552602 May 27 19:52:19.414937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 112/221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:18 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:19.472715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:19.476643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:19.488068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.488827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.492485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.493236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.605230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:19.620538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1f9e40e9-fb73-4486-b584-ced0730bcd65 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1328 microversion: 2.1 time: 0.151290 May 27 19:52:19.630784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 110/222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:19 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1328 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:19.874612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:19.875329 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:19.886665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.886665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.889761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.890708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.905824 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:19.906445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:19.918127 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.918571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:19.919356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:19.919799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.225108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:20.238154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:20.269466 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2660b3b3-3c5e-4e71-8b8d-6db5fca75f60 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.396350 May 27 19:52:20.270911 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a72b558e-0c51-4927-8043-aec9e7c8849a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.371609 May 27 19:52:20.275302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 113/223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:19 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:20.282602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 111/224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:19 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:20.284818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:20.288894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:20.302463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:20.307725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.315197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:20.315197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.423135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-616058f9-59c2-4eac-a67e-d9011921d0bb req-27467494-16b8-46a2-a8af-8358e77a6247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a8e8f6-08f1-4ac5-beae-03501818ff8f", "tag": "d371d39e-9fa3-40f7-80a7-99cd4a49eb25"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:20.454662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-616058f9-59c2-4eac-a67e-d9011921d0bb req-27467494-16b8-46a2-a8af-8358e77a6247 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:20.455129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-616058f9-59c2-4eac-a67e-d9011921d0bb req-27467494-16b8-46a2-a8af-8358e77a6247 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.480203 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-616058f9-59c2-4eac-a67e-d9011921d0bb req-27467494-16b8-46a2-a8af-8358e77a6247 service nova] Creating event network-changed:d371d39e-9fa3-40f7-80a7-99cd4a49eb25 for instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f on hv-cinder-83979 May 27 19:52:20.489927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-616058f9-59c2-4eac-a67e-d9011921d0bb req-27467494-16b8-46a2-a8af-8358e77a6247 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070870 May 27 19:52:20.492615 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 112/225] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:20.512799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:20.513800 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:20.538707 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:20.539395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.541011 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:20.541855 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:20.927585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:20.943701 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:20.947182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:20.951058 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-711b3e3e-d193-4ab1-b302-5c19c9b3bd19 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.672162 May 27 19:52:20.952349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 114/226] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:20 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:20.976338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:20.979870 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:20.995062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.005917 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:21.010055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.010966 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:21.408750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:21.425669 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-37c60d19-8f5d-495e-95c1-6701ba78fbb4 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.456035 May 27 19:52:21.430026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 115/227] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:20 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:21.434901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:21.440108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:21.453391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.457807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:21.460189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.461527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:21.478114 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:21.568988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:21.581806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:21.591400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0e3f09f2-527a-4d10-8789-f776e5bf716f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 1.095981 May 27 19:52:21.594542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 113/228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:20 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:21.621267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:21.624791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:21.649323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.653117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:21.664444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:21.668033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:22.163851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:22.177535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8771f8d3-8483-43e5-8e8d-a4ee95e7329a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.576073 May 27 19:52:22.186572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 114/229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:21 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:22.206267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:22.208169 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:22.228323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:22.230660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:22.231660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:22.234878 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:22.342620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:22.357913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1672221d-69a8-453b-8939-cca53af50478 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.928817 May 27 19:52:22.359959 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 116/230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:21 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:22.447098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:22.447718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:22.466980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:22.470884 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:22.472005 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:22.473915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.313404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:23.449472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-767bd065-6b60-4062-a19f-0fdd28c67b1e tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.888443 May 27 19:52:23.449472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 117/231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:22 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:23.449472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-097cdad3-baed-4a0e-8319-d566d9fef1af req-b87a8905-0f84-416e-825d-f63d420c9628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade62dfd-7f2c-4fe0-b483-c92b8095fe5e", "tag": "76354613-7bcd-414c-95cb-3781be2ce447"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:23.450866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:23.451290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-097cdad3-baed-4a0e-8319-d566d9fef1af req-b87a8905-0f84-416e-825d-f63d420c9628 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:23.451290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-097cdad3-baed-4a0e-8319-d566d9fef1af req-b87a8905-0f84-416e-825d-f63d420c9628 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.451290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-097cdad3-baed-4a0e-8319-d566d9fef1af req-b87a8905-0f84-416e-825d-f63d420c9628 service nova] Creating event network-changed:76354613-7bcd-414c-95cb-3781be2ce447 for instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e on hv-cinder-83979 May 27 19:52:23.451290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-097cdad3-baed-4a0e-8319-d566d9fef1af req-b87a8905-0f84-416e-825d-f63d420c9628 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096789 May 27 19:52:23.451590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:23.457000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 118/232] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:23.471633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:23.477179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:23.483213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:23.489192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1041823d-31eb-45b9-a1dc-0dcd6f8b0aa5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 1.301026 May 27 19:52:23.514793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 115/233] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:22 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:23.515233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:23.521582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:23.528068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:23.532288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:23.540914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.542017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:23.544801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.555004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:23.556145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.561400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:23.561973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:23.954860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:23.963638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8fde115d-1f40-4479-98db-2a1400aca093 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.465324 May 27 19:52:23.969131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:23 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:23.989061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:23.990579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:24.015805 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:24.021124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:24.028410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:24.033586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:24.195673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=12 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:24.638219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:24.649502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:24.662941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-11c7648d-2c58-4070-82c9-4a7bcdf6e554 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.684881 May 27 19:52:24.665428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 117/235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:23 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:24.683820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:24.696087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:24.741847 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:24.752292 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:24.752292 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:24.752292 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.020713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.047101 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ef815be5-cca3-4e92-8386-16cf3dee8323 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.367099 May 27 19:52:25.049853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:24 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:25.070900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:25.074304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:25.098346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.101535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.105710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.106536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.133077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.141159 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e1b8ff48-787d-4dda-bbd3-b15002ef0a4c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 1.677499 May 27 19:52:25.150440 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 119/237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:23 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:25.165301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:25.175086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:25.197954 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.198483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.199375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.199849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.703429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.728369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.730681 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.732294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9fc7121d-cca1-4e13-9fa5-3c68000c6c3e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.680279 May 27 19:52:25.734057 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 119/238] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:25 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:25.751359 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-aa5c8de1-0fe0-4c1f-b272-1dcd1a66b840 req-cc397fbb-824f-4b95-a277-1b3268efc626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:25.789636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-aa5c8de1-0fe0-4c1f-b272-1dcd1a66b840 req-cc397fbb-824f-4b95-a277-1b3268efc626 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.792611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-aa5c8de1-0fe0-4c1f-b272-1dcd1a66b840 req-cc397fbb-824f-4b95-a277-1b3268efc626 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.853127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:25.859743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-aa5c8de1-0fe0-4c1f-b272-1dcd1a66b840 req-cc397fbb-824f-4b95-a277-1b3268efc626 service nova] Creating event network-changed:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:52:25.860685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-48e6ddf1-6060-4da0-83ad-5d2c20024f23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.706252 May 27 19:52:25.863044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 120/239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:25 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:25.868452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:25.869136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:25.876160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-aa5c8de1-0fe0-4c1f-b272-1dcd1a66b840 req-cc397fbb-824f-4b95-a277-1b3268efc626 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138633 May 27 19:52:25.882802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 120/240] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:25.887625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.888066 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:25.889023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:25.889628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.067902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:26.068645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:26.076104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.076752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.077400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=22 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:26.081400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.081400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.089731 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.105072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1cde15ec-76c1-4a2d-bc1d-5908b8318df2 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.238789 May 27 19:52:26.105703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 121/241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:25 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:26.169567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:26.171002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:26.182561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.183009 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.185096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.185712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.300415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.309301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4d0063bb-2742-463b-90f3-73c2ec356096 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.245884 May 27 19:52:26.322604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 121/242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:26 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:26.494347 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.511057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-98e309c2-f85b-4036-859d-2cf89fc9a15d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.339286 May 27 19:52:26.531621 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 122/243] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:26 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:26.751895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:26.752528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:26.763060 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.763501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.764274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.764696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.879549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:26.882053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:26.889804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.890258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.891066 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:26.891554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:26.938284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.946674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.948187 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:26.949534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-31191a2d-a932-4f74-b311-92b18aad3e12 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.201745 May 27 19:52:26.950276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 122/244] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:26 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:27.065257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:27.077283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-af572ee6-e1a0-4424-bd44-cee8009a52b0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.202586 May 27 19:52:27.078491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 123/245] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:26 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:27.126976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:27.126976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:27.144209 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.144666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.145472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.145915 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.343010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:27.344085 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:27.351407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.352129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.353101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.353681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.476561 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:27.514063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1d381979-cf13-479f-b8a7-f43253d0f075 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.367843 May 27 19:52:27.523757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:27 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:27.543632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:27.550587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:27.576714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.577178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.577954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.578386 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.688615 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:27.715557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2f0e67de-907a-49c3-9668-c7c8a60d30c2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.376848 May 27 19:52:27.729310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 124/247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:27 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:27.873280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:27.884886 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1b508599-9075-492e-b088-661ed28a1ccc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.346465 May 27 19:52:27.889455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 124/248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:27 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:27.968431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:27.969426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:27.992757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.993355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:27.995111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:27.996216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.096063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:28.096766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:28.124411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.125165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.126055 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.127794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.316997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:28.329802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:28.332011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:28.333488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-30f75a4c-df6b-44e9-b494-e862bdc062a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.369696 May 27 19:52:28.346843 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 125/249] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:27 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:28.524180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:28.525160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:28.535784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.538826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.544417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.545121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.557312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:28.579510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fff77797-beb6-4682-9a01-0da5d571ca33 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.481100 May 27 19:52:28.592398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 125/250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:28 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:28.736613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:28.736613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:28.750506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.751245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.761489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.767313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.811132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:28.823049 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6cb85fcb-27b0-4963-a493-952535dca181 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.304512 May 27 19:52:28.830694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:28 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:28.933253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:28.933253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:28.933253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.933253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:28.933606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:28.933606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:29.746489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:29.746489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-eac1b5de-55a3-4b09-80d8-01d870e4ea73 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 1.006382 May 27 19:52:29.766989 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 126/252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:28 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:29.796291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:29.806207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:29.822085 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:29.826723 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:29.830045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:29.830509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.105187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.115597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7772358e-09ad-4ea7-891c-a62d8e1b7fe3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 1.212188 May 27 19:52:30.120825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 127/253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:28 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:30.133805 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.134619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:30.135537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:30.142503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.143370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.144371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.145086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.150644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.152279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.154308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fc69f170-92ea-46c3-9212-3ff22ae763eb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.381855 May 27 19:52:30.166120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 127/254] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:29 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:30.190358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:30.192318 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:30.211067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.211510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.212310 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.212742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.610058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.628485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-81cf2fa0-9cfb-404f-8063-2cb7be615c57 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.459817 May 27 19:52:30.630993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 128/255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:30 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:30.639591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-21a56696-2586-4323-b511-b98918c15ef6 req-1174205e-a9c0-47dc-b86c-ca3125b2c375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade62dfd-7f2c-4fe0-b483-c92b8095fe5e", "name": "network-vif-plugged", "status": "completed", "tag": "76354613-7bcd-414c-95cb-3781be2ce447"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:30.653322 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-21a56696-2586-4323-b511-b98918c15ef6 req-1174205e-a9c0-47dc-b86c-ca3125b2c375 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.653995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-21a56696-2586-4323-b511-b98918c15ef6 req-1174205e-a9c0-47dc-b86c-ca3125b2c375 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.654196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:30.684674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1df6bb02-1efb-4dad-8e54-2459f8fb4721 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.544799 May 27 19:52:30.684674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 128/256] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:30 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:30.712412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-21a56696-2586-4323-b511-b98918c15ef6 req-1174205e-a9c0-47dc-b86c-ca3125b2c375 service nova] Creating event network-vif-plugged:76354613-7bcd-414c-95cb-3781be2ce447 for instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e on hv-cinder-83979 May 27 19:52:30.725115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-21a56696-2586-4323-b511-b98918c15ef6 req-1174205e-a9c0-47dc-b86c-ca3125b2c375 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090701 May 27 19:52:30.725976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 129/257] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:30.758016 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:30.758643 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:30.773425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.773425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:30.773425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:30.775497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.139834 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:31.140462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:31.151532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.151991 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.157518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.158064 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.671826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:31.684598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-90b48ba2-8f3f-4176-a8ff-127d69c4efeb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.932311 May 27 19:52:31.686751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 129/258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:30 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:31.701138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:31.701138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:31.711620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.716026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.717208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.718141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.725752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:31.744457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-484783df-dbe6-4011-ad18-4ae3458c7233 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.610117 May 27 19:52:31.746644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:31 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:31.758210 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:31.759034 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:31.774239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.774239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:31.775098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:31.775852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.093735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:32.098409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:32.104847 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e2f5bef9-27c0-4279-86df-0caf85827814 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.357432 May 27 19:52:32.109090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 131/260] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:31 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:32.119179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:32.121191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:32.136598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.137084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.143767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.147371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.153278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:32.172014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:32.175386 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:32.185385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6933af17-ebb0-44de-9b20-9046e9d09d35 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.496875 May 27 19:52:32.186390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 130/261] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:31 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:32.406356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:32.417767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-47ee1e5d-2568-4466-8566-76b0eb7adcca tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.310687 May 27 19:52:32.418983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 132/262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:32 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:32.705653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:32.706525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:32.716768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.718047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.719131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.720018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.778157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:32.778928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:32.815707 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.816973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:32.821084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:32.824371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.103500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.114748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-84afe257-3c13-43bf-901c-e171fdef02d0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.414046 May 27 19:52:33.116545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 131/263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:32 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:33.125766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:33.135738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:33.157720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.167568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.167568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.167568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.262325 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.277728 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1580c240-16ba-49f1-b136-f6fc8876cd99 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.513057 May 27 19:52:33.278640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 133/264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:32 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:33.304302 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:33.309364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:33.328816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.332258 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.333506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.336498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.557938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.571229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-15ca4091-9e5e-420f-a9d9-15c2bddf4396 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1313 microversion: 2.1 time: 0.449169 May 27 19:52:33.584500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 132/265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:33 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:33.598626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:33.603197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:33.622840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.630300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.630300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.630300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.681178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:33.761526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.775619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.777571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:33.784531 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-960e7058-edbb-447f-8fcb-7b316c9eacf9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.494945 May 27 19:52:33.785679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 134/266] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:33 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:33.791795 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-fdc5cd46-2b4a-40fd-9f5a-4ed853bb02b5 req-0ce864fe-1472-4993-b9fa-6ef40a47c15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a8e8f6-08f1-4ac5-beae-03501818ff8f", "name": "network-vif-plugged", "status": "completed", "tag": "d371d39e-9fa3-40f7-80a7-99cd4a49eb25"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:33.812514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-fdc5cd46-2b4a-40fd-9f5a-4ed853bb02b5 req-0ce864fe-1472-4993-b9fa-6ef40a47c15a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:33.814533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-fdc5cd46-2b4a-40fd-9f5a-4ed853bb02b5 req-0ce864fe-1472-4993-b9fa-6ef40a47c15a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:33.850606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-fdc5cd46-2b4a-40fd-9f5a-4ed853bb02b5 req-0ce864fe-1472-4993-b9fa-6ef40a47c15a service nova] Creating event network-vif-plugged:d371d39e-9fa3-40f7-80a7-99cd4a49eb25 for instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f on hv-cinder-83979 May 27 19:52:33.882498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-fdc5cd46-2b4a-40fd-9f5a-4ed853bb02b5 req-0ce864fe-1472-4993-b9fa-6ef40a47c15a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089143 May 27 19:52:33.884017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 135/267] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:34.042383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:34.050651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d21c1eb0-405f-4aaf-8f36-162d1ae93f38 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.461543 May 27 19:52:34.051656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 133/268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:33 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:34.136655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:34.138784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:34.167146 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.173148 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:34.176892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.178046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:34.295888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:34.296627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:34.322535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.322993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:34.323869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.324302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:34.668050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:34.681702 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-df410c61-7424-4d01-a7e0-17ecce560a0a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.553144 May 27 19:52:34.691183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:34 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:34.691183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-687758523", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:34.884236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:34.891803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-22c0967a-d56d-4fe6-a486-1c7e8be1f66d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.600123 May 27 19:52:34.912803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 134/270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:34 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:34.922488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:34.929938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:34.944151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.945455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:34.945455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:34.945836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.356611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:35.367029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e30bec26-14e1-492a-83e4-26bf0e852549 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1498 microversion: 2.1 time: 0.452862 May 27 19:52:35.369249 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 135/271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:34 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1498 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:35.374779 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:35.375654 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:35.400504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.406187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.414674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.415897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.652270 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:35.660634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:35.667381 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:35.672683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6663f9f7-66bd-4b99-9830-8e6872aa0143 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.298071 May 27 19:52:35.672683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 136/272] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:35 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:35.686700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:35.687314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:35.690289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:35.698304 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.699259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.700485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.701279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.939664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:35.953194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5e126c85-b5c6-4555-90b4-2fc6c2ba16bf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.279340 May 27 19:52:35.969615 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 137/273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:35 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:35.983287 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:35.984680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:35.996322 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.997373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:35.998912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:35.999926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:36.284058 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:36.297950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b9410ed0-66bd-4dcb-94f6-601947e220d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.326657 May 27 19:52:36.311335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 138/274] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:35 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:36.318318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:36.319177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:36.349264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:36.349264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:36.349264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:36.354643 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:36.612839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:36.622554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-01fabaf2-c9df-4374-a0ff-1619fd30b7d8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.309529 May 27 19:52:36.624003 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 139/275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:36 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:36.691492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:36.692086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:36.700050 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:36.700489 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:36.701294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:36.701724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:36.754420 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:52:37.448044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-08726f15-cfee-4cc1-a88a-af82442e30a5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 204 len: 0 microversion: 2.1 time: 0.760495 May 27 19:52:37.451833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 140/276] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:52:36 2022] DELETE /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:52:37.456802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:37.457529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:37.466736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:37.467180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:37.471447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:37.472105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:37.748397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:37.761916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:37.763706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:37.765144 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a763bf88-cde6-45ba-9f8f-09fc40a92ea5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.314911 May 27 19:52:37.786036 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 141/277] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:37 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:37.791354 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:37.791958 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:37.807551 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:37.808986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:37.813843 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:37.814376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:37.980203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:37.988387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-60a8808e-659d-4a7f-a39c-6f5f8a023854 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.200991 May 27 19:52:37.990060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 142/278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:37 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:37.995589 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:37.996421 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:38.004801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.008395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.008395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.008395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.180842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.189429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d6623843-a2b5-43e7-bc09-a2dd8bdd1eac tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.197857 May 27 19:52:38.199060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 143/279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:37 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:38.199060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:38.199060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:38.202376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.203005 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.203650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.204120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.245876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] validate_networks() for None {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:52:38.613550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.622131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-09b5c7b7-ed24-4551-8c99-0bcf7ce7baa8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.431092 May 27 19:52:38.632998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 144/280] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:38 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:38.632998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:38.632998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:38.640757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.641246 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.642019 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.642449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.654914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:52:38.655831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:52:38.656729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:52:38.660090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:52:38.660561 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:52:38.672238 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.672627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.673419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.673851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.692975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Getting quotas for project 96ab6f56bbb34547a1fa2548159e7579. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:38.697746 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Getting quotas for user f7870acb5f8b447e8ebb86eaa2ecfcfa and project 96ab6f56bbb34547a1fa2548159e7579. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:38.708758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:52:38.711031 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:52:38.792411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.799984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a1db7bc0-8d06-45ba-b306-aa0a9a7f4e7b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1367 microversion: 2.1 time: 0.176078 May 27 19:52:38.800630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 145/281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:38 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:38.805984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:38.806939 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:38.812650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.813126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.813874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:38.814304 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:38.867535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ce3d8c1d-00bc-4b2e-a3d7-87332103f306 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.183778 May 27 19:52:38.868394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 137/282] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:52:38.879287 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5aa9d8e6-2de7-4de3-80a3-676b5d0dbe39 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:38.881410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5aa9d8e6-2de7-4de3-80a3-676b5d0dbe39 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:38.942021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5aa9d8e6-2de7-4de3-80a3-676b5d0dbe39 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.950737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5aa9d8e6-2de7-4de3-80a3-676b5d0dbe39 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1214 microversion: 2.1 time: 0.076067 May 27 19:52:38.960419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 138/283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:38 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:38.984733 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.994328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.995897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:38.997234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b08097c7-41ea-4f3e-a43e-7dff873cb9df tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.195350 May 27 19:52:38.997820 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 146/284] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:38 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:39.006570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.007172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.013920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.014816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.015104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.015532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.150720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:39.158396 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4c33bdb3-ae8a-4353-a511-8d55d7c85027 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.155806 May 27 19:52:39.159636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:39.206259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.206872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.213623 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.214014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.214785 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.215224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.346876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:39.354691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d11c1f3d-cd83-4ec1-89bd-704a3cfa2cca tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.152323 May 27 19:52:39.355252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 147/286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:39.640398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.641021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.647155 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.647600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.648358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.648784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.778468 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:39.785921 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-be21c3c7-40bf-45a7-99e5-5303d86ddad5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.149675 May 27 19:52:39.787246 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 140/287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:39.817287 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.818192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.824810 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.825297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.826057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.826638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.845008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:39.960425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:39.967870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.968470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.968584 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ee7a6170-b0cf-4d34-beda-89198eb21dd3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1557 microversion: 2.1 time: 0.155143 May 27 19:52:39.969318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 148/288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:39.975378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.975821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.976587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.977066 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.985542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:39.986115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:39.992756 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.993307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:39.994067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:39.994486 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.039365 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.046717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8b6786da-78d5-4af3-ba6a-22adfb1720ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1218 microversion: 2.1 time: 0.082974 May 27 19:52:40.047274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 141/289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:40.052044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:40.052646 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:40.061088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.061088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.061088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.061088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.076169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-28b1f440-272e-4bee-8c16-fdf0cd2a9930 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094565 May 27 19:52:40.077114 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 149/290] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:52:39 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:52:40.180406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:40.181272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:40.187638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.188123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.189145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.189743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.197471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.206971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.208750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.210111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7622f0f6-837e-4cb3-b560-91cc0cd92ade tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.161942 May 27 19:52:40.221549 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 142/291] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:40 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:40.371666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:40.372382 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:40.374380 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:40.379115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.379557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.380574 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.381035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.415414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.425552 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4bde4956-7781-433b-b353-ce5aea04af9d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.249982 May 27 19:52:40.426320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 150/292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:40 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:40.526972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:40.534662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b8f6e64e-f853-47d0-80f3-136c4ff751f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.166832 May 27 19:52:40.535269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 143/293] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:40 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:40.803865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:40.804463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:40.810696 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.811160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:40.811924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:40.812355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.043855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.051356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b7f9518f-ad01-4947-b3f7-6fa952671461 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.251404 May 27 19:52:41.052543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 151/294] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:40 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:41.066688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:41.068232 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:41.074440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.074884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.075648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.076081 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.138268 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.145812 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2b1f0983-0c84-4317-b144-64c87d8e7ff8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1218 microversion: 2.1 time: 0.082898 May 27 19:52:41.146456 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 144/295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:41 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:41.218783 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-b51457c6-98ba-48eb-a0d8-dd4ea93bda81 req-585d5352-3a19-4b36-bf22-222cb3bbd457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87a8e8f6-08f1-4ac5-beae-03501818ff8f", "tag": "d371d39e-9fa3-40f7-80a7-99cd4a49eb25"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:41.227413 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b51457c6-98ba-48eb-a0d8-dd4ea93bda81 req-585d5352-3a19-4b36-bf22-222cb3bbd457 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.228048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b51457c6-98ba-48eb-a0d8-dd4ea93bda81 req-585d5352-3a19-4b36-bf22-222cb3bbd457 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.229426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:41.230025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:41.237760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.238645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.241403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.241968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.242681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-b51457c6-98ba-48eb-a0d8-dd4ea93bda81 req-585d5352-3a19-4b36-bf22-222cb3bbd457 service nova] Creating event network-changed:d371d39e-9fa3-40f7-80a7-99cd4a49eb25 for instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f on hv-cinder-83979 May 27 19:52:41.249195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-b51457c6-98ba-48eb-a0d8-dd4ea93bda81 req-585d5352-3a19-4b36-bf22-222cb3bbd457 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034181 May 27 19:52:41.250183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 152/296] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:41.391861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.401652 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.405247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.405247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-921d9820-610d-44d3-915e-4bd2309087f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.180347 May 27 19:52:41.405606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 145/297] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:41 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:41.445393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:41.445393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:41.451414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.452005 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.452856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.453564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.554712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:41.555328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:41.561825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.562679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.563617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:41.564242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:41.606869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.621613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8610c87a-2081-40cc-ba52-1d715c04bd73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.182734 May 27 19:52:41.622228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 153/298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:41 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:41.707723 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:41.715288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-37cfd1e3-f4f1-4109-be11-e048161be8c3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.166715 May 27 19:52:41.715861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 146/299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:41 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:42.069119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:42.069725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:42.076675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.077153 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.077927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.078358 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.163451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:42.164662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:42.176654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.177636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.178412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.178842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.246488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.251952 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.262605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5b898c02-a304-483b-bb62-cffb6e913064 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.197060 May 27 19:52:42.266941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a3af8ac7-a8b8-493a-8695-74ca68fc0ded tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1218 microversion: 2.1 time: 0.107596 May 27 19:52:42.267749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 154/300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:42 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:42.268243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 147/301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:42 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:42.425010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:42.425890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:42.432474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.437127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.437127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.437127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.577455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.586307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.587813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.589023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c8aefb96-19fb-49ef-8a48-5e8524ecab3f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.168007 May 27 19:52:42.589576 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 155/302] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:42 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:42.639945 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:42.640628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:42.651083 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.651782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.652558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.653413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.732772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:42.733464 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:42.741410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.741852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.743082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:42.743540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:42.817844 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.826082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1df69c79-a9ad-45f3-a045-fdb1c9ba1394 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.189973 May 27 19:52:42.826657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 148/303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:42 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:42.888431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:42.897040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1ee49d52-6d88-4ee8-a266-66abc9b3a7d2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.167966 May 27 19:52:42.897600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 156/304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:42 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:43.280757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:43.281567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:43.284025 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:43.284668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:43.289035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.289926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.290948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.291527 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.292756 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.293223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.293988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.294423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.374191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.384386 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bf1e713a-d82e-4bba-be93-d42fd8f2c456 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1210 microversion: 2.1 time: 0.104423 May 27 19:52:43.384970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 157/305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:43 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:43.444881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.453318 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dcebf14b-dbec-44ca-9cef-78b3eee03f0b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.176668 May 27 19:52:43.453821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 149/306] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:43 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:43.607604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:43.608204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:43.614408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.614850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.615602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.616030 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.747185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.755829 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.757341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.758484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3f6214f8-2a0b-4758-baa3-69e7d75718f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.154775 May 27 19:52:43.759036 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 158/307] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:43 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:43.843905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:43.844512 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:43.850836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.851277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.852030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.852461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.914249 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:43.914943 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:43.921953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.923529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.924438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:43.925046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:43.985213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:43.988745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:43.993614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4b59ecd0-e99b-46a8-aef7-6f6a7b2960fc tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.153933 May 27 19:52:43.994183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 150/308] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:43 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:44.057751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.065175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1825d7c3-427f-43ff-8d67-2c6ef1e84902 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.155108 May 27 19:52:44.065734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 159/309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:43 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:44.402502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:44.403141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:44.409052 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.409506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.410287 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.410720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.472061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:44.472720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:44.478409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.480285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.480967 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.481886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.482329 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.486952 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-21c6c31e-7126-46e1-8db7-5ff33ba7edef tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1210 microversion: 2.1 time: 0.088624 May 27 19:52:44.487521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 151/310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:44 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:44.616168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.624185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1e1b779c-11f8-43e6-b761-ba33bb7ab3b3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.156904 May 27 19:52:44.624746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 160/311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:44 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:44.775449 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:44.776051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:44.782114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.789139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.789139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:44.789139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:44.913351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.921206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.922701 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:44.923835 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d4fb62ff-f49b-4839-8a69-f50013e50e6e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.152280 May 27 19:52:44.924387 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 152/312] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:44 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:45.011138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:45.011733 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:45.017919 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.018359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.019108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.019535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.082838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:45.083444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:45.089952 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.090406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.091204 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.091637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.152805 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:45.160196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9d4806a1-a050-48ec-8988-53df76e0cae2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.152939 May 27 19:52:45.160795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 161/313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:45 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:45.225601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:45.232854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-97617b22-03d2-465f-b66e-b1a2873b2d78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.154160 May 27 19:52:45.233443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 153/314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:45 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:45.503467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:45.504076 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:45.515749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.515749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.515749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.515749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.575598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:45.583441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d2a7b4e3-a909-4fe0-99f0-637b440da726 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1210 microversion: 2.1 time: 0.083165 May 27 19:52:45.584007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 162/315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:45 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:45.641297 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:45.641940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:45.648460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.648906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.649697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.650134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.781850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:45.790337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fe233605-5c18-4175-be14-a1d692e28f24 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.152870 May 27 19:52:45.790902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 154/316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:45 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:45.943067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:45.943677 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:45.949801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.950244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:45.950993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:45.951419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.084251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.092092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.093858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.095000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7eafa24f-822b-4b9c-b393-bf45faada7ce tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1739 microversion: 2.20 time: 0.156400 May 27 19:52:46.095587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 163/317] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:45 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:46.177643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:46.178427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:46.184370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.184813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.185610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.186039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.244412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3acce93d-2991-4428-bb39-5b40f589835a req-b96843dd-95f5-4cc8-b2b2-1bf1a9041b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade62dfd-7f2c-4fe0-b483-c92b8095fe5e", "name": "network-vif-unplugged", "status": "completed", "tag": "76354613-7bcd-414c-95cb-3781be2ce447"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:46.260488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3acce93d-2991-4428-bb39-5b40f589835a req-b96843dd-95f5-4cc8-b2b2-1bf1a9041b4c service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.260926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3acce93d-2991-4428-bb39-5b40f589835a req-b96843dd-95f5-4cc8-b2b2-1bf1a9041b4c service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.273913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3acce93d-2991-4428-bb39-5b40f589835a req-b96843dd-95f5-4cc8-b2b2-1bf1a9041b4c service nova] Creating event network-vif-unplugged:76354613-7bcd-414c-95cb-3781be2ce447 for instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e on hv-cinder-83979 May 27 19:52:46.279189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3acce93d-2991-4428-bb39-5b40f589835a req-b96843dd-95f5-4cc8-b2b2-1bf1a9041b4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042914 May 27 19:52:46.280524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 164/318] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:52:46.286128 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:46.287001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:46.293805 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.294720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.295239 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.295776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.335068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.347588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b7e3d14c-bf88-4194-928c-529a1e64824e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.172580 May 27 19:52:46.348438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 155/319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:46 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:46.459787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.469714 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fa5b35db-4820-4a18-96e0-6b79d1977bf0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.188011 May 27 19:52:46.470322 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 165/320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:46 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:46.602629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:46.603243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:46.609288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.609735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.610496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.610930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.675964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.683883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f7c9765e-af09-47f8-976c-2da5d8325d8e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1210 microversion: 2.1 time: 0.086012 May 27 19:52:46.684452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 156/321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:46 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:46.807662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:46.808351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:46.815373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.815819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.816644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:46.817138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:46.953286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:46.956809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:46.961359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-77f3e05c-3b96-4ed4-82cc-8abca611ab70 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.157633 May 27 19:52:46.961924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 166/322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:46 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:47.113771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:47.114761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:47.120968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.121441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.122225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.122659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.256876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.264875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.268677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.268677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-74a25010-09e4-4fdf-a685-51a9b2b14641 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1721 microversion: 2.20 time: 0.157998 May 27 19:52:47.268677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 157/323] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:47 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:47.366388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:47.367018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:47.373725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.374176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.374946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.375384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.487502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:47.488484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:47.501116 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.501929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.502940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.503588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.619738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.628504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5adb39bf-80a0-4734-8690-6294d9e0b22c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.267344 May 27 19:52:47.640581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 167/324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:47 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:47.701674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:47.702418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:47.709297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.709749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.710526 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.710956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.809314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.817307 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c1cb4a24-35d8-4d3b-aab8-1bc69eddeabc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.333661 May 27 19:52:47.829162 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 158/325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:47 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:47.830629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:47.841979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3efab243-014f-4616-ac91-f60f1326048a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1266 microversion: 2.1 time: 0.144391 May 27 19:52:47.843119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 168/326] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:47 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:47.979943 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:47.980755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:47.987212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.987744 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:47.988633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:47.989088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.179065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:48.192047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-53fc1850-fff8-4838-ba5b-c89780712795 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1504 microversion: 2.1 time: 0.211605 May 27 19:52:48.192047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 159/327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:47 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:48.289446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:48.290282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:48.297007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-97c626c7-76d5-4211-93ce-7f53fd42afc3 req-20e1a8aa-0fdf-444f-b6b0-86d5c1d5148b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "name": "network-vif-unplugged", "status": "completed", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:48.299782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.300806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.301858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.302530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.307417 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-97c626c7-76d5-4211-93ce-7f53fd42afc3 req-20e1a8aa-0fdf-444f-b6b0-86d5c1d5148b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.308041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-97c626c7-76d5-4211-93ce-7f53fd42afc3 req-20e1a8aa-0fdf-444f-b6b0-86d5c1d5148b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.334199 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-97c626c7-76d5-4211-93ce-7f53fd42afc3 req-20e1a8aa-0fdf-444f-b6b0-86d5c1d5148b service nova] Creating event network-vif-unplugged:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:52:48.340635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-97c626c7-76d5-4211-93ce-7f53fd42afc3 req-20e1a8aa-0fdf-444f-b6b0-86d5c1d5148b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047403 May 27 19:52:48.341619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 160/328] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:52:48.585825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:48.596549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:48.599419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:48.600809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f5a0b4ee-037d-4d3e-88d1-0759cfaebd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1721 microversion: 2.20 time: 0.318197 May 27 19:52:48.612585 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 169/329] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:48 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1721 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:48.648758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:48.649568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:48.656196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.656738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.657628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.658067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.683865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:48.824441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-98b96459-7de9-448f-8fb6-8204749632cb req-549ba242-5bee-4f9f-94e7-377fbeee3695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade62dfd-7f2c-4fe0-b483-c92b8095fe5e", "name": "network-vif-deleted", "tag": "76354613-7bcd-414c-95cb-3781be2ce447"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:48.836142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-98b96459-7de9-448f-8fb6-8204749632cb req-549ba242-5bee-4f9f-94e7-377fbeee3695 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.836670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-98b96459-7de9-448f-8fb6-8204749632cb req-549ba242-5bee-4f9f-94e7-377fbeee3695 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.849399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-98b96459-7de9-448f-8fb6-8204749632cb req-549ba242-5bee-4f9f-94e7-377fbeee3695 service nova] Creating event network-vif-deleted:76354613-7bcd-414c-95cb-3781be2ce447 for instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e on hv-cinder-83979 May 27 19:52:48.854876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-98b96459-7de9-448f-8fb6-8204749632cb req-549ba242-5bee-4f9f-94e7-377fbeee3695 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 May 27 19:52:48.855580 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 170/330] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:48.863832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:48.865382 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:48.875251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.875650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.876550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:48.876874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:48.950347 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=8 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:49.002609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.011381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-db49e641-5401-4171-a0ba-4038b7917599 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.367648 May 27 19:52:49.012046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 161/331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:48 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:49.025941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:49.026544 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:49.028460 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.032968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.033845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.034847 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.035368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.038493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-982ee5d4-ff4b-4c2f-895f-e08588713f78 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.181718 May 27 19:52:49.049081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 171/332] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:48 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:49.100456 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.107970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-10e66dcf-0d80-42b4-8200-8173e3f7c740 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1272 microversion: 2.1 time: 0.085859 May 27 19:52:49.108534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 162/333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:49 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:49.206831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:49.207524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:49.214253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.214693 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.215446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.215871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.248799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.249271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.249710 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lazy-loading 'fault' on Instance uuid ade62dfd-7f2c-4fe0-b483-c92b8095fe5e {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:52:49.298496 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.306882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e29918a9-f6af-4c2d-9606-a41ab28fe7b4 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1303 microversion: 2.1 time: 0.103888 May 27 19:52:49.307540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 172/334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:49 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:49.619384 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:49.620045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:49.626534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.626973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.627941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:49.628369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:49.880622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.890223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.891908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:49.893678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-34d4bb97-e360-446f-a1e9-5890cf8593f8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1721 microversion: 2.20 time: 0.278190 May 27 19:52:49.894135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 163/335] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:49 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:50.028312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:50.028871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:50.035403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.035846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.036650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.037105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.065120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:50.065727 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:50.073963 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.074357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.075024 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.075477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.185208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:50.194519 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2be085a3-4dd0-41af-82a1-9542722b8845 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.169912 May 27 19:52:50.195270 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 173/336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:50 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:50.200760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:50.201757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:50.208145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.208581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.209478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.209910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.227440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:50.236920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ca75182a-5b4d-48ed-8666-2a052fae028d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.175926 May 27 19:52:50.238017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 164/337] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:50 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:50.327926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:50.328657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:50.335581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.336190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.337044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.337490 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.354338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:50.363275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-907143ca-54c2-4707-a9ce-4c0c0de96590 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.166682 May 27 19:52:50.369189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 174/338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:50 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:50.373407 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.373863 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.374332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lazy-loading 'fault' on Instance uuid ade62dfd-7f2c-4fe0-b483-c92b8095fe5e {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:52:50.422629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:50.430970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-18830ead-dba7-432b-9ae8-bc5d0ea5553f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1303 microversion: 2.1 time: 0.107100 May 27 19:52:50.431525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 165/339] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:50 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:50.912289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:50.913174 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:50.919264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.919713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:50.920520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:50.921055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.074383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.083653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.085391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.086641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0e7fd7b8-88e6-47a4-8140-eb901e19a180 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1721 microversion: 2.20 time: 0.178807 May 27 19:52:51.088197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 175/340] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:50 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:51.214458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:51.215059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:51.224316 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.224771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.225610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.226710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.256571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:51.257227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:51.263837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.264756 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.269215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.269215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.464813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.474758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-40bfd70c-c997-4e09-a202-72ef57fc5ba5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.263381 May 27 19:52:51.475435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 166/341] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:51 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:51.489279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:51.491551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:51.498974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.499608 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.500554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.501234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.508829 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.516674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-059ab037-234a-4b80-a5fd-dc5830958f4b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.265751 May 27 19:52:51.517214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 176/342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:51 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:51.522858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:51.523469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:51.540530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.543108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.543108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.543108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.580391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.580834 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.581309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lazy-loading 'fault' on Instance uuid ade62dfd-7f2c-4fe0-b483-c92b8095fe5e {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:52:51.642494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.651712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-419dbd3f-d316-436c-812a-34ef34923c81 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 200 len: 1303 microversion: 2.1 time: 0.132810 May 27 19:52:51.654913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 177/343] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:51 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:51.727831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-cbad0826-524c-4bb3-a075-beb38c89c080 req-51d8b6e4-a065-4292-8d02-ea527f622bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a84a5f-07f5-4c8f-9ded-910a7cde6e63", "tag": "731a9786-0376-4456-a474-4ec54334e896"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:51.736300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-cbad0826-524c-4bb3-a075-beb38c89c080 req-51d8b6e4-a065-4292-8d02-ea527f622bea service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:51.736940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-cbad0826-524c-4bb3-a075-beb38c89c080 req-51d8b6e4-a065-4292-8d02-ea527f622bea service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:51.739999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:51.745124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:51.749607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-cbad0826-524c-4bb3-a075-beb38c89c080 req-51d8b6e4-a065-4292-8d02-ea527f622bea service nova] Creating event network-changed:731a9786-0376-4456-a474-4ec54334e896 for instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 on hv-cinder-83979 May 27 19:52:51.751928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-98e0a0cc-4ff3-4751-b7a0-91aeaec4f819 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.266343 May 27 19:52:51.755776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-cbad0826-524c-4bb3-a075-beb38c89c080 req-51d8b6e4-a065-4292-8d02-ea527f622bea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032241 May 27 19:52:51.756815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 178/344] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:51.758221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 167/345] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:51 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:52.107453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:52.108140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.114473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.115088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.115850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.116288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.242363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.250296 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.251752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.252912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d2d8ff51-a70f-4210-8267-ede5bf5f00a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1664 microversion: 2.20 time: 0.150205 May 27 19:52:52.253507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 179/346] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:52 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:52.270870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "645ae4a2-3dbd-4f96-b8ea-d9b741c5032b"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:52.272027 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.278577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.279016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.279764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.280192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.492391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:52.493027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.499127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.499573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.500416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.500864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.634444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.642404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-877dfc9d-9658-49fc-92b8-487915e01afe tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.154644 May 27 19:52:52.643050 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 180/347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:52 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:52.648066 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:52.654183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.654552 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.655006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.655843 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.656343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.787842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.795321 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-96cd583a-f816-40ca-84cf-7867c36c1baf tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.151413 May 27 19:52:52.797566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 181/348] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:52 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:52.800273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:52.800859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: ade62dfd-7f2c-4fe0-b483-c92b8095fe5e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.804180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:52.807577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.808017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.808800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.809260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.822490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] HTTP exception thrown: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Request method failure captured: May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e HTTP/1.1 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSvnRcXXthPsoV9LB0QMHq0SpVTrXT8MblUGoPw_RY9tG0GdCbEKSLsGBCf7Vg2zb1RvGPXXKPo25L5DRcIyq_6-AYE_U8B5ZWhC2LW8jQWo-wrew0Ji1AZvkQAHhg28894hGSwgC4qNCBp9syC3e0Eh7O5nT2-8gkrrAIRHtNW3PdA May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 729158c0db83438a9b762aae3f0009a2 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesActionsTest-595160046 May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:52:52.824091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/729158c0db83438a9b762aae3f0009a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/729158c0db83438a9b762aae3f0009a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_729158c0db83438a9b762aae3f0009a2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/729158c0db83438a9b762aae3f0009a2"}]}] May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesActionsTest-595160046 May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 729158c0db83438a9b762aae3f0009a2 May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesActionsTest-595160046 May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesActionsTest-595160046-project May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 83d3494760b84bc1aad951bba11caea3 May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesActionsTest-595160046-project May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. May 27 19:52:52.825728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'ade62dfd-7f2c-4fe0-b483-c92b8095fe5e'} May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:52:52.826755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. May 27 19:52:52.828132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:52:52.829282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Returning 404 to user: Instance ade62dfd-7f2c-4fe0-b483-c92b8095fe5e could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:52:52.829282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a592acad-1518-4fef-a73f-38a288a1c9f1 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e" status: 404 len: 111 microversion: 2.1 time: 0.028736 May 27 19:52:52.829282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 182/349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:52 2022] GET /compute/v2.1/servers/ade62dfd-7f2c-4fe0-b483-c92b8095fe5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:52:52.830482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:52.831092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:52.837645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.838088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.838846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:52.839797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:52.993598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:52.998336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8d5efb8f-c5a5-40b5-b146-c00735bb371f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.171305 May 27 19:52:52.998925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 183/350] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:52 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:53.003444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1636497767", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "networks": [{"uuid": "fc05afcc-37bd-43c8-b1dc-0dfa370b7d83"}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:53.054293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] validate_networks() for [('fc05afcc-37bd-43c8-b1dc-0dfa370b7d83', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:52:53.304806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-592f45e5-e526-4477-a479-25a736144e2e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.037816 May 27 19:52:53.305633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 168/351] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 27 19:52:52 2022] POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments => generated 188 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 19:52:53.407371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:52:53.408364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:52:53.408864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:52:53.409290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:52:53.409866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:52:53.421113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.421556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.422345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.422771 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.423079 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:53.423633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:53.430517 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.430972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.431746 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.432181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.440071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Getting quotas for project 729158c0db83438a9b762aae3f0009a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:52:53.445509 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Getting quotas for user 83d3494760b84bc1aad951bba11caea3 and project 729158c0db83438a9b762aae3f0009a2. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:52:53.456812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:52:53.459414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:52:53.599380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7f79ee2a-e6a5-4174-8be6-353a8ac7d048 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599358 May 27 19:52:53.600084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 184/352] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:52:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:52:53.614577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-23ca6070-e468-4d3e-ad59-ef1ff2efd00c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:53.615203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-23ca6070-e468-4d3e-ad59-ef1ff2efd00c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:53.669203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-23ca6070-e468-4d3e-ad59-ef1ff2efd00c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:53.677222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-23ca6070-e468-4d3e-ad59-ef1ff2efd00c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1214 microversion: 2.1 time: 0.066867 May 27 19:52:53.677856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 185/353] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:53 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:53.691181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:53.691767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:53.698946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-754300c0-98e5-496a-bbd0-5d892d3e6cd4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/action" status: 202 len: 0 microversion: 2.20 time: 0.279032 May 27 19:52:53.699690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 169/354] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 19:52:53 2022] POST /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 19:52:53.710792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:53.710792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:53.714252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.714720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.715510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.715944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.718923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.719427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.720192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.720621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.740359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:53.872219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:53.876481 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:53.881770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0d7257c9-255a-4a63-acfd-9f42c5b947b1 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.193942 May 27 19:52:53.882352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 186/355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:53 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:53.887222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:53.887813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:53.894534 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.898208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:53.898346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.898346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:53.898346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:53.898653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:53.898653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b9f69c92-953e-40c2-a0bc-02c644682944 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1750 microversion: 2.20 time: 0.194214 May 27 19:52:53.899474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 170/356] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:53 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1750 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:54.015360 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:54.018227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:54.029953 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.033477 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.034293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.034736 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.059366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:54.068012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0b87248b-e82b-4cd6-852a-c0976cbfddfb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.183998 May 27 19:52:54.068746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 187/357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:53 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:54.176976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:54.184342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dc6049b1-7e89-46b6-9253-2588ac512788 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.172723 May 27 19:52:54.184900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 171/358] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:54 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:54.695376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:54.696096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:54.702743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.703275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.704103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.704535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.772828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:54.781472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-65daf1bd-4772-4869-87b9-c7a3129465cf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1218 microversion: 2.1 time: 0.091110 May 27 19:52:54.782032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 188/359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:54 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:54.852671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-0713d8e3-28b1-45f5-a7d1-197fc7c354e9 req-a19dbdb0-d7fd-470f-a837-805132525bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "name": "network-vif-plugged", "status": "completed", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:52:54.862416 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0713d8e3-28b1-45f5-a7d1-197fc7c354e9 req-a19dbdb0-d7fd-470f-a837-805132525bed service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.862946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0713d8e3-28b1-45f5-a7d1-197fc7c354e9 req-a19dbdb0-d7fd-470f-a837-805132525bed service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.875361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-0713d8e3-28b1-45f5-a7d1-197fc7c354e9 req-a19dbdb0-d7fd-470f-a837-805132525bed service nova] Creating event network-vif-plugged:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:52:54.880595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-0713d8e3-28b1-45f5-a7d1-197fc7c354e9 req-a19dbdb0-d7fd-470f-a837-805132525bed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 May 27 19:52:54.881138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 172/360] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:52:54.898611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:54.899209 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:54.905468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.905912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.906665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.907098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.917872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:54.919295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:54.924873 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.925356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:54.926120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:54.927568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.057793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.075182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-95fe7dcf-03fc-4430-83f5-adc33120050f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.174843 May 27 19:52:55.075182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 189/361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:54 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:55.086208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:55.087224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:55.096979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.100760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.100760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.100760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.110041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.119480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.122223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.123392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1326a18a-2994-4d7c-8395-a92085456f51 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1750 microversion: 2.20 time: 0.209705 May 27 19:52:55.134193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 173/362] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:54 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:55.211383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:55.212133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:55.223889 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.225047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.226032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.226508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.239457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.260879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-301015d1-9498-4602-91a1-63a1c45e19eb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.178235 May 27 19:52:55.261791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 190/363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:55 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:55.448487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.457880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-364a391e-5344-4daf-9438-53f5355cc94e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.253304 May 27 19:52:55.458813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 174/364] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:55 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:55.803938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:55.804547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:55.811192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.811644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.812430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:55.812869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:55.879093 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:55.886911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-afb3198c-7984-4fd8-b18d-4022bd233e93 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1210 microversion: 2.1 time: 0.087124 May 27 19:52:55.887570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 191/365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:55 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:56.087131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:56.088764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:56.095832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.096634 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.097585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.098206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.143046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:56.143696 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:56.151416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.152251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.153275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.153912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.242404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.250003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bf78fdcc-e593-48d9-a0f3-b09ede48e333 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.166779 May 27 19:52:56.250961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 175/366] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:56 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:56.278614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:56.279300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:56.286293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.286743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.287696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.288286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.324318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.333426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.334957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.336137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fe788a30-231e-43ca-a51c-0f45212d12b8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1752 microversion: 2.20 time: 0.198244 May 27 19:52:56.336879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 192/367] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:56 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:56.429466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.436910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-52747e82-064e-431e-a9f3-a5c4a79df8e6 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.162108 May 27 19:52:56.437895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 176/368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:56 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:56.475581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:56.476186 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:56.482338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.482782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.483540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.483972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.615411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.623009 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-752989ff-de9f-43af-a9ad-b906752e6033 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.151296 May 27 19:52:56.623571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 193/369] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:56 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:56.904472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:56.905138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:56.911181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.911625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.912382 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:56.912833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:56.974625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:56.981967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-74956d2f-5743-40ec-82bf-c0d7d99797d7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1266 microversion: 2.1 time: 0.081340 May 27 19:52:56.982528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 177/370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:56 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:57.267127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:57.267731 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:57.274450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.274895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.275654 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.276090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.355932 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:57.356912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:57.362965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.363595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.368040 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.368494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.415793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.423700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5439f20a-7bfb-4009-8d4c-9b49997f7735 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1522 microversion: 2.1 time: 0.160373 May 27 19:52:57.424463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 194/371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:57 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:57.454786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:57.455488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:57.462556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.463091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.463941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.464515 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.510539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.521761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.524170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.524666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-80b70d78-5b9d-4399-b887-20a35e2b2b4e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1752 microversion: 2.20 time: 0.172621 May 27 19:52:57.525250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 178/372] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:57 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:57.605732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.613089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-56379611-8401-41e2-99ac-d4c3965b3c7b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.162270 May 27 19:52:57.613656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 195/373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:57 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:57.639528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:57.640157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:57.647014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.647451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.648234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:57.648849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:57.789383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:57.796913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5ebeaac8-c1c2-4eff-abe6-1f0b43034546 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.161160 May 27 19:52:57.801594 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 179/374] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:57 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:57.998613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:57.999139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.005732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.006420 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.007181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.007615 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.069310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.076705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4c78e701-3a95-4ddb-ba52-e67a0c4f54b0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1266 microversion: 2.1 time: 0.082114 May 27 19:52:58.077287 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 196/375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:57 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:58.439965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:58.440566 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.447623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.456992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.456992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.456992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.543974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:58.544545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.551305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.551750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.553502 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.553942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.580558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.588307 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2ad7264a-f919-44f2-ba0a-62cfd31eb7ba tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1502 microversion: 2.1 time: 0.152117 May 27 19:52:58.588875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 180/376] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:58 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:58.605005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:58.605605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.611574 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.612012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.612765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.613230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.632381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:58.688473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.697861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.699407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.700599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1f1041de-5761-4e57-b5b5-6d50e3a5edd1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1752 microversion: 2.20 time: 0.160475 May 27 19:52:58.701192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 197/377] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:58 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:52:58.705752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:58.706533 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.716848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.717262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.718283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.718718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.752756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.761168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8f24c8c0-df6b-412f-a987-c8a5a1cd8c73 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1515 microversion: 2.1 time: 0.159854 May 27 19:52:58.761659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 181/378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:58 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:58.817239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:58.817852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:58.824884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.825379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.826282 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:58.826892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:58.852830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.861655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-247c57f4-0e8d-4f4e-9ac9-885f32cdf6e0 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1358 microversion: 2.1 time: 0.159444 May 27 19:52:58.862462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 198/379] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:58 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:58.967742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:58.975677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-57223948-50ed-4758-94bb-8cdc05b8f094 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.162684 May 27 19:52:58.976436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 182/380] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:58 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:52:59.093955 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:59.094681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:59.100975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.101501 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.102262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.102691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.166001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:59.173733 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c29740a4-760f-4319-bf50-ee8deca4c200 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1266 microversion: 2.1 time: 0.083888 May 27 19:52:59.177858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 199/381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:59 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:52:59.719809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:59.720438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:59.727393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.727843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.728614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.737990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.861636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:59.870759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:59.872395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:52:59.873531 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c5418f48-e59a-43f4-8f5c-59ac7d219564 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1752 microversion: 2.20 time: 0.158005 May 27 19:52:59.874128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 183/382] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:52:59 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:52:59.879553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:59.887126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:52:59.887272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.887722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.888479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:52:59.888909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:52:59.992910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:52:59.994075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.000016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.000464 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.001259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.001695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.026215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.031954 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-60ecaa9c-53ab-460e-9f56-45dfb86fb588 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1548 microversion: 2.1 time: 0.156231 May 27 19:53:00.032527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 200/383] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:59 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:00.050485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:00.051322 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.057940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.060755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.060755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.060755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.208119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.217797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-764c0bcc-fdf5-4f40-9687-ed9825dc0257 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1548 microversion: 2.1 time: 0.170867 May 27 19:53:00.218379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 201/384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:00 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:00.223117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:00.223716 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.230359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.231024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.231817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.232233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.300199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.310342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-828245dd-8216-468f-ab79-df92ed47a4bd tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1274 microversion: 2.1 time: 0.090459 May 27 19:53:00.310950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 202/385] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:00 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:00.316315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:00.320260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.320942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.322086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Searching by: {'deleted': False, 'project_id': '0ca4fe16a0204d0db4289e293771581b'} {{(pid=124677) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 19:53:00.327902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-691d9f58-dfc9-4752-b43a-d07c9ba35cb7 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.339995 May 27 19:53:00.329980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.330704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.331565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.331982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.337857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 184/386] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:52:59 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:00.405100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:00.426494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.multi_cell_list [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124677) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 19:53:00.538109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d057ae05-f2de-4b7e-8137-470560d44606 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223150 May 27 19:53:00.539271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 203/387] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 19:53:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:00.549717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:00.550895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.558791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.560414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.561404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.562064 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.620149 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:00.621469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.628800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.630232 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.631285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.631831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.676052 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'flavor' on Instance uuid d81fcd54-4eed-417b-bd06-11187de21f7d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:00.899069 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:00.908157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-26ae2e36-e59e-426c-b49f-5bf63ec94b75 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1548 microversion: 2.1 time: 0.362111 May 27 19:53:00.909127 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 185/388] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:00 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1548 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:00.914792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:00.915314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:00.923080 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.923536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:00.924771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:00.929499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.139200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7b050369-3076-4562-a438-108dbcb4b780 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/action" status: 200 len: 32 microversion: 2.1 time: 0.523928 May 27 19:53:01.144883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 204/389] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:53:00 2022] POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 19:53:01.152301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:01.153548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:01.159429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.159928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.163627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.163627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.177947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.187077 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.190601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.190601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3d9a5a9f-dadd-4617-bd57-8de868417db5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.279917 May 27 19:53:01.191356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 186/390] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:00 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:01.307110 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.321071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-673ed365-8b9e-48ec-9f75-614ee0433be9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.174807 May 27 19:53:01.321663 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 205/391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:01 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:01.335508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:01.336391 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:01.348007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:01.348941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:01.382007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.383119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.384163 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.388044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.389030 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.389494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.390276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:01.390713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:01.674862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.683392 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5568d7e6-e830-4ddb-9ccb-08771c24d485 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.340760 May 27 19:53:01.683986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 206/392] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:01 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:01.730645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:01.741620 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-259be4cd-3d3a-4fd4-88a1-b9f1cfc92d3f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.413745 May 27 19:53:01.742216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 187/393] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:01 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:02.209797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:02.211128 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:02.219001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.219675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.220631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.221285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.337843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:02.339114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:02.346824 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.348037 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.350495 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.351454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.427021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:02.437394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:02.438905 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:02.440476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b77e26ab-0dc9-4335-8406-79f3e21ce305 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.235423 May 27 19:53:02.441284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 207/394] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:02 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:02.562334 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:02.577394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c9b3442e-4d27-4669-b605-1c159371d2c3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.238019 May 27 19:53:02.577394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 188/395] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:02 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:02.699700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:02.700338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:02.706552 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.706999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.707751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.708191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.759306 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:02.760295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:02.766906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.768081 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.769377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:02.770551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:02.855034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:02.864867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1d1996b2-0431-4220-8af7-ed7909035054 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.168940 May 27 19:53:02.865798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 208/396] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:02 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:02.997529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:03.005051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8b776876-78c4-407b-a52c-7db1dfb566db tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.250315 May 27 19:53:03.006350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 189/397] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:02 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:03.129112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-9d4000aa-7965-47d5-a400-62b02edb7c57 req-d679e781-3f40-4243-b12e-96dac945ef84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0", "tag": "a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:03.138864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-9d4000aa-7965-47d5-a400-62b02edb7c57 req-d679e781-3f40-4243-b12e-96dac945ef84 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.139302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-9d4000aa-7965-47d5-a400-62b02edb7c57 req-d679e781-3f40-4243-b12e-96dac945ef84 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.154950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-9d4000aa-7965-47d5-a400-62b02edb7c57 req-d679e781-3f40-4243-b12e-96dac945ef84 service nova] Creating event network-changed:a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf for instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 on hv-cinder-83979 May 27 19:53:03.159833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-9d4000aa-7965-47d5-a400-62b02edb7c57 req-d679e781-3f40-4243-b12e-96dac945ef84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034639 May 27 19:53:03.160481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 209/398] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:03.459994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:03.460604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:03.468253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.468695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.470591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.470591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.591046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:03.591744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:03.598157 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.598636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.600053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.600475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.603678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:03.612555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:03.614403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:03.616497 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-74710f7f-058a-4861-8c14-7daf9f8fae1d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160975 May 27 19:53:03.626101 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 190/399] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:03 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:03.673449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=8 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:03.740985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:03.748541 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4fbbd354-ea68-47eb-8fd7-9fb17320b312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.162176 May 27 19:53:03.749139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 210/400] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:03 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:03.882342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:03.883047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:03.884886 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:03.889672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.894022 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:03.894022 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:03.894022 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.023406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:04.024315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:04.030984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.031437 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.032227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.032662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.038604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.046053 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-17427e72-f701-42f1-8c58-0d0847ca53eb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.168549 May 27 19:53:04.046616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 191/401] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:03 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:04.164278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.171799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3034c0a2-f05c-4027-8857-7ac4dcd43b53 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.153045 May 27 19:53:04.172360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 211/402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:04 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:04.635868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:04.636481 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:04.642485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.644722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.644722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.644722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.765481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:04.766087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:04.773781 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.774123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.776424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:04.776881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:04.780765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.789453 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.790994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.792734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4e3365a2-1d8a-4903-a179-39d8a677a8b6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160331 May 27 19:53:04.793015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 192/403] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:04 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:04.927803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:04.936543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dcdff027-8a10-4286-aaed-fc4c10dd564d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.175102 May 27 19:53:04.937233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 212/404] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:04 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:05.062026 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:05.062636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:05.069219 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.069662 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.070440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.071054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.193859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:05.196240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:05.220375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.220829 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.221712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.222077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.369005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:05.379686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:05.390871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-38ae819f-83bb-45f1-aafa-0a7aeef67062 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.323618 May 27 19:53:05.391037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-eb9dd687-2cff-456f-8915-8cd60aa25e37 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.203889 May 27 19:53:05.391037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 213/405] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:05 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:05.406414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 193/406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:05 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:05.410961 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1b68f9d2-0169-4391-b0f7-9083b74fe973 req-d83dfc88-a773-45df-a55f-d5ed1e792f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a84a5f-07f5-4c8f-9ded-910a7cde6e63", "name": "network-vif-plugged", "status": "completed", "tag": "731a9786-0376-4456-a474-4ec54334e896"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:05.425412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1b68f9d2-0169-4391-b0f7-9083b74fe973 req-d83dfc88-a773-45df-a55f-d5ed1e792f78 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.425412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1b68f9d2-0169-4391-b0f7-9083b74fe973 req-d83dfc88-a773-45df-a55f-d5ed1e792f78 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.437362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1b68f9d2-0169-4391-b0f7-9083b74fe973 req-d83dfc88-a773-45df-a55f-d5ed1e792f78 service nova] Creating event network-vif-plugged:731a9786-0376-4456-a474-4ec54334e896 for instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 on hv-cinder-83979 May 27 19:53:05.443273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1b68f9d2-0169-4391-b0f7-9083b74fe973 req-d83dfc88-a773-45df-a55f-d5ed1e792f78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052342 May 27 19:53:05.444185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 214/407] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:05.810651 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:05.811254 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:05.818100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.818454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.819295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.819732 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.955178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:05.955888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:05.962779 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.963765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:05.964970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:05.965428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:06.108469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.108469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.109390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.109390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-32d5265b-fbf3-44c0-9333-c386da28ef1b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.295422 May 27 19:53:06.109390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 194/408] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:05 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:06.150679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.158465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-049f07ff-b883-41b5-9790-a69060c1b197 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.208002 May 27 19:53:06.159035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 215/409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:05 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:06.402867 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:06.403370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:06.409592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:06.410027 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:06.410789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:06.411268 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:06.413571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:06.414178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:06.420129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:06.420568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:06.421345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:06.421776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:06.548960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.556932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:06.557314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4929ed95-be84-40ff-891c-62534bb09058 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.158396 May 27 19:53:06.557926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 195/410] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:06 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:06.564403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f9cebbea-85fc-42eb-9379-e45f2c4aa74e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.155316 May 27 19:53:06.564974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 216/411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:06 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:07.122708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:07.123319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:07.129254 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.131600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.131600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.131600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.175471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:07.177603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:07.184284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.184728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.185513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.186353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.270078 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.280288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.286820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.288025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-53622538-31c8-4726-9263-95cb6adcda5b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.169121 May 27 19:53:07.288604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 196/412] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:07 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:07.330359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.338202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a56259d8-50e5-42c7-9acb-cce8661b327d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.166523 May 27 19:53:07.338774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 217/413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:07 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:07.369628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8561f19-eb76-4add-a193-40ff630be144"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:07.370748 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:07.377171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.377618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.378389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.378819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.575741 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:07.576364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:07.585485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.585940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.586703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.587143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.735569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.741081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:07.748036 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7903bfab-8fef-4bf6-a52b-f30d74c2a1c3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.176051 May 27 19:53:07.752994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 218/414] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:07 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:07.762229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:07.762850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:07.769503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.770199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.772188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:07.772530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:07.977746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:07.991692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-98ae5b03-5c02-48b6-8f0b-fb4dd03579c0 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.241522 May 27 19:53:08.004112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 219/415] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:07 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:08.307505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:08.308210 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:08.314154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.314596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.315345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.315773 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.495390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:08.504237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:08.506684 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:08.507880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bc8dc307-5450-4359-8e44-dff7c8b9b56a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.204392 May 27 19:53:08.508430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 220/416] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:08 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:08.513380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:08.514193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:08.524341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.525105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.526268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.533694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.704063 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:08.713694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f84594a2-d467-46b3-b162-3f3bc3debe5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.203895 May 27 19:53:08.714278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 221/417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:08 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:08.768137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:08.769188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:08.776784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.777549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.778325 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:08.778764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:08.923846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:08.932518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1d1b38ab-4583-420e-aebe-5e0896a6fe4f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.168885 May 27 19:53:08.933123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 222/418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:08 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:09.020537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:09.021361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:09.027687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.028352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:09.029336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.033326 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:09.233674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:09.248401 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-38db152d-1749-46da-b58d-0f36462b6acf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.228476 May 27 19:53:09.255096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 223/419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:09 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:09.527040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:09.528418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:09.531605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:09.542496 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.542944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:09.543713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.544141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:09.760544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:09.769835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:09.772158 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:09.773858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ef950aa2-9264-4989-bed6-bb32f8893bd2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.251022 May 27 19:53:09.774713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 224/420] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:09 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:09.782087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:09.783350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:09.807424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.807883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:09.808681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:09.809227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.188403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.205332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3d835858-cb52-4fe5-ae67-61b3c2a69775 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.429062 May 27 19:53:10.206245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 225/421] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:09 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:10.213147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:10.214021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:10.222886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.224006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.225061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.225646 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.381813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:10.417557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.425792 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9d054e78-285c-4d44-b854-0cfb5966c76e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.218520 May 27 19:53:10.427138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 226/422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:10 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:10.432068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:10.432796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:10.438963 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.440708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.440708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.440708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.596679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.607010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d2c93644-ced7-49d8-8a7d-715c9d5d2c5f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.177008 May 27 19:53:10.607607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 227/423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:10 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:10.792500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:10.794029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:10.800653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.801496 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.802632 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:10.803435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:10.938548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.948557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.950074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:10.951270 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-61768815-b268-4616-aed0-b88a2e439d39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.163300 May 27 19:53:10.951826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 228/424] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:10 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:11.234229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:11.234846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:11.241470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.241925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.242697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.243133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.412894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:11.421109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3de76151-eaeb-4db9-a00b-9c1304e8a43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.198419 May 27 19:53:11.431686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 229/425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:11 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:11.444386 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:11.445388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:11.457177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.457983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.458792 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.459225 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.600450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:11.608053 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-428016d7-8422-4486-8e84-5e4ef9d551cd tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.168170 May 27 19:53:11.608827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 230/426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:11 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:11.626753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:11.627683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:11.635971 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.636423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.637277 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.638289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.770188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:11.778362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b4c9e3dc-f57e-4614-bd36-826e54438bcf tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.156697 May 27 19:53:11.779230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 231/427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:11 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:11.970441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:11.971041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:11.978549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.979002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:11.979772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:11.980204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.128116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:12.137343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:12.138874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:12.140044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6ad33b28-4a5c-4034-a345-684163256cd3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.173799 May 27 19:53:12.140607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 232/428] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:11 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:12.424622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-25c2560d-9985-4dcd-8b66-b4987ea78fc6 req-eda52119-63db-4e1c-955c-e6e20f954506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0", "name": "network-vif-plugged", "status": "completed", "tag": "a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:12.431480 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-25c2560d-9985-4dcd-8b66-b4987ea78fc6 req-eda52119-63db-4e1c-955c-e6e20f954506 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.431992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-25c2560d-9985-4dcd-8b66-b4987ea78fc6 req-eda52119-63db-4e1c-955c-e6e20f954506 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.453702 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-25c2560d-9985-4dcd-8b66-b4987ea78fc6 req-eda52119-63db-4e1c-955c-e6e20f954506 service nova] Creating event network-vif-plugged:a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf for instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 on hv-cinder-83979 May 27 19:53:12.461438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-25c2560d-9985-4dcd-8b66-b4987ea78fc6 req-eda52119-63db-4e1c-955c-e6e20f954506 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043624 May 27 19:53:12.464865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 233/429] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:12.467697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:12.468389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:12.475648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.476096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.476894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.477329 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.649152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:12.656774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cbf8ef2c-0c06-4272-973f-342379929465 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.193475 May 27 19:53:12.659399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 234/430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:12 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:12.665252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:12.666392 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:12.673241 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.673861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.674640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.675057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.829483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:12.838186 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-19c8b702-8ae7-486d-9c5d-e1029b2badc0 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.177418 May 27 19:53:12.841012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 235/431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:12 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:12.844245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:12.845180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:12.852433 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.857442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.857442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:12.857442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:12.858683 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:13.000037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:13.009635 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-01ea2f54-1595-43e2-a446-41481539ed8a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.169886 May 27 19:53:13.010218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 236/432] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:12 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:13.164376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:13.164901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:13.171286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.171728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:13.172489 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.172925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:13.310979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:13.320874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:13.322528 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:13.323765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f1af416c-1f24-46ac-b26e-1496ee8e8e76 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.163732 May 27 19:53:13.324320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 237/433] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:13 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:13.674299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:13.675012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:13.682599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.682982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:13.683759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.684197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:13.824763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:13.833176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a1b22494-1f02-4ebd-bc91-d84a01ce8bb0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.162583 May 27 19:53:13.838653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 238/434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:13 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:13.856935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:13.857949 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:13.865924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.866478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:13.867384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:13.867956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.009135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:14.023884 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fa7d2700-02ff-46e1-b278-556403924d3c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.164151 May 27 19:53:14.024691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 239/435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:13 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:14.029279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:14.029890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:14.049113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.049524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.050333 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.050814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.189167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:14.198576 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-878b31ee-a187-4331-a629-fa3b2130f3ff tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.172597 May 27 19:53:14.199313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 240/436] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:14 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:14.343047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:14.343571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:14.349740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.350189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.350958 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.351397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.484183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:14.494064 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:14.495700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:14.496912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b8d0f010-bb6e-4cbd-8659-ba54b2619f28 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.158082 May 27 19:53:14.497497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 241/437] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:14 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:14.851680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:14.852431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:14.860265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.860726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:14.866655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:14.866655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.012028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.019941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6b7809a3-3c61-4bcb-829d-921f0aaebd3d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.172994 May 27 19:53:15.020508 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 242/438] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:14 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:15.040848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:15.041474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:15.047303 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.047806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.048495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.048920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.193583 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.203135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5d6815a3-178b-4f66-b0fa-c440662896c5 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.165706 May 27 19:53:15.204002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 243/439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:15 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:15.215908 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:15.218709 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:15.223568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.224331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.225457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.225981 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.365849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.374182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b67a0acc-4d35-4073-92c6-6ad19626fce5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.162097 May 27 19:53:15.375200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 244/440] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:15 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:15.526243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:15.527275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:15.534851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.535744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.537572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:15.538392 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:15.710548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.720301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.721997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:15.723219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-661fcfe7-33ed-4c2f-b755-5dbc6248e1fb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.211277 May 27 19:53:15.723826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 245/441] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:15 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:16.038898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:16.039699 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:16.046789 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.047242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.048090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.048527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.197729 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.206137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dba2a6c1-1f62-4783-9b6d-1c08340c1f0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.172089 May 27 19:53:16.209111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 246/442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:16 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:16.221232 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:16.227887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:16.230240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.230693 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.231473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.231905 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.377624 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.386561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-66698ebb-ba83-4d52-b007-6f4f3ee9e6bb tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.169388 May 27 19:53:16.387150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 247/443] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:16 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:16.392318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:16.392917 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:16.399784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.400248 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.401309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.401754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.544845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.564349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5fcb4ed4-e553-4626-9ca0-17e6583b441b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.174165 May 27 19:53:16.564349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 248/444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:16 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:16.744078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:16.744774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:16.751192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.751775 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.752819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:16.753427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:16.902347 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.910911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.912474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:16.913723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2624033e-7e0d-4c89-b4ed-7e4194e60dba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.174087 May 27 19:53:16.914283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 249/445] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:16 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:17.227568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:17.228314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:17.237377 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.237849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.238660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.239081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.376016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=13 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:17.401667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:17.409639 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-93a65bb0-f755-48d1-8b4a-37fb57cfed3c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.189150 May 27 19:53:17.411692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 250/446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:17 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:17.416261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:17.416946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:17.423227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.423664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.424421 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.424850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.456564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=98 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:17.591034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:17.599308 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8c1bbaa8-51b3-4e9c-accf-126ad09e7500 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.186577 May 27 19:53:17.599884 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 251/447] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:17 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:17.609611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:17.609611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:17.611540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.611985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.612746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.613196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.763169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:17.766895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:17.770852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-146ef2d0-d75b-42b1-b61f-b32ce2afe1b6 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.169933 May 27 19:53:17.771482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 252/448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:17 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:17.932723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:17.933399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:17.939630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.940390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:17.941378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:17.941892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.076262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.084983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.086492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.087646 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-33df4e86-6b0e-43c6-9979-b2fd38277013 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.159013 May 27 19:53:18.088199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 253/449] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:17 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:18.427541 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:18.428233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:18.434720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.435173 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.435939 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.436374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.569929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.577881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7f731220-123b-497e-ac14-743fb436dd44 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.154855 May 27 19:53:18.578444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 254/450] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:18 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:18.617227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:18.617867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:18.623832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.624281 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.625061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.625497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.756006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.763657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1a171193-d506-443e-b86b-16cd93ed22ca tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1314 microversion: 2.1 time: 0.150420 May 27 19:53:18.764226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 255/451] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:18 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:18.787922 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:18.788520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:18.794566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.795017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.795847 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:18.796284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:18.925629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:18.933557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-92c0f1d0-b168-4f9c-86a1-d32e1141278b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.149958 May 27 19:53:18.934142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 256/452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:18 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:19.116603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:19.118164 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:19.127092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.127535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.128307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.128738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.303981 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:19.312626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:19.314167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:19.315327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-308603a1-9a33-4592-8e77-eb3b039c958c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.208253 May 27 19:53:19.315890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 257/453] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:19 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:19.595890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:19.596564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:19.604057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.604571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.605410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.605869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.744605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:19.752147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f71df40f-0596-4408-b71b-d1a689b30c9b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.160626 May 27 19:53:19.752665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 258/454] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:19 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:19.780737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:19.781363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:19.788005 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.788481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.789335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.789762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.928457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:19.936260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ec4c4b11-f844-40f1-bd94-2f0e49eca55e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1464 microversion: 2.1 time: 0.159301 May 27 19:53:19.936828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 259/455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:19 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:19.951883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:19.952556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:19.959991 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.960449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:19.961260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:19.961850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.113818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.123214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cb3f3e0d-ff61-4178-8255-250910a8480b tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.176003 May 27 19:53:20.123868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 260/456] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:19 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:20.128429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:20.131959 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:20.137790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.138350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.139191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.139696 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.166821 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:53:20.480797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-30c07ec6-3b36-41f9-b691-780d0b112899 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 204 len: 0 microversion: 2.1 time: 0.355360 May 27 19:53:20.481497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 261/457] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:53:20 2022] DELETE /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:53:20.486736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:20.487458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:20.494234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.494932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.495450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.495899 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.497327 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6b97fb32-d805-472a-9ea1-93eaec83e61b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.131472 May 27 19:53:20.504999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 197/458] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:53:07 2022] POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments => generated 194 bytes in 13136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:20.511673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:20.511673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:20.526965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.529378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.529378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.529378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.656077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.664732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.666276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.667422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5e608207-f570-4e4c-a50e-5004afad2997 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.184948 May 27 19:53:20.667978 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 262/459] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:20 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:20.669554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.677726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3ef6f12b-fe5a-4835-a843-c569dc46b589 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1470 microversion: 2.1 time: 0.174947 May 27 19:53:20.678561 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 198/460] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:20 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:20.769787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:20.770464 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:20.786183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.786834 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.788359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:20.788842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:20.931493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:20.939045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8584197d-005e-4a07-8a1e-48b8209be619 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.173285 May 27 19:53:20.939610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 263/461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:20 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:21.141215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:21.142239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:21.149530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.149979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.150740 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.151173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.281366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:21.290339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5fa0c1f9-0303-4e07-97e6-3513aa663072 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.153167 May 27 19:53:21.291272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 199/462] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:21 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:21.686181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:21.686772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:21.695637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:21.696232 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:21.702360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.702800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.703568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.703994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.711393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.715295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.715295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.715295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.863491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:21.872937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:21.874495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:21.875694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-aa5143f4-3f49-4680-a0bc-86524a65fe6a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.193341 May 27 19:53:21.876251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 264/463] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:21 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:21.886857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:21.895124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fffa7f36-5871-4776-a0a0-c53051a9bfc9 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1470 microversion: 2.1 time: 0.203830 May 27 19:53:21.896722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 200/464] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:21 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:21.955724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:21.956561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:21.963025 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.963469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:21.964236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:21.964670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.103244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:22.111138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-12efd9f5-c6c4-4b37-85cc-d65b5e48d3f0 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.159298 May 27 19:53:22.111827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 265/465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:21 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:22.307886 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:22.308487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:22.315066 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.315516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.316278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.316712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.462797 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:22.470466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-19e97774-8547-4c14-8853-3f080b0b3681 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.166478 May 27 19:53:22.471036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 201/466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:22 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:22.902600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:22.902600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:22.904230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.908765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.908765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.908765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.914494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:22.916072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:22.922882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.923336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:22.924165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:22.924607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:23.051066 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.061461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.063156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.064263 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2097ad8c-c2f5-4902-b11a-64f93cb9d777 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.173411 May 27 19:53:23.065032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 266/467] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:22 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:23.088645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.096532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e3ab67f3-c5fe-4897-b1c2-2b056ebec4d2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1470 microversion: 2.1 time: 0.186867 May 27 19:53:23.097113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 202/468] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:22 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:23.127639 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:23.128342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:23.134826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:23.141559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:23.141559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:23.141559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:23.271112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.275224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:23.279997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-aecc92f3-dd5b-4f96-a185-1b51f97a152d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.156196 May 27 19:53:23.280566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 267/469] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:23 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:23.487685 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:23.488346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:23.494874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:23.495320 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:23.496075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:23.496508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:23.626166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:23.634673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b6ed2099-e6c0-4c72-a2f6-94da4417043e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.150833 May 27 19:53:23.635256 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 203/470] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:23 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:24.082633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:24.083320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:24.090868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.091309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.092332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.092761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.114782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:24.120272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:24.121893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.122609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.124058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.124498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.239776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.248464 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.249988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.251143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ce175f66-bc3a-4d22-9b5f-f44722dd61f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.172545 May 27 19:53:24.251704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 268/471] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:24 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:24.284854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.292267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a226cd56-5bff-4c07-8039-d115906dabdf tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1470 microversion: 2.1 time: 0.181919 May 27 19:53:24.293161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 204/472] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:24 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:24.297877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:24.298485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:24.304722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.305209 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.305996 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.306465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.439152 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.447377 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1c37251c-def6-4e44-a6d1-47f7c07d8a0e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.153659 May 27 19:53:24.447935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 269/473] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:24 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:24.651900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:24.652578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:24.665230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.665686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.666718 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:24.666902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:24.880755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:24.888265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-076883a9-88a6-41a4-bf35-ab05390b96da tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1314 microversion: 2.1 time: 0.240197 May 27 19:53:24.898415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 205/474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:24 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:25.156637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-e8f892d6-89a9-4008-984e-5797aa08267a req-d5451acc-f017-4203-94c9-067f3c356563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a84a5f-07f5-4c8f-9ded-910a7cde6e63", "name": "network-vif-deleted", "tag": "731a9786-0376-4456-a474-4ec54334e896"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:25.165990 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-e8f892d6-89a9-4008-984e-5797aa08267a req-d5451acc-f017-4203-94c9-067f3c356563 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.166432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-e8f892d6-89a9-4008-984e-5797aa08267a req-d5451acc-f017-4203-94c9-067f3c356563 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.179140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-e8f892d6-89a9-4008-984e-5797aa08267a req-d5451acc-f017-4203-94c9-067f3c356563 service nova] Creating event network-vif-deleted:731a9786-0376-4456-a474-4ec54334e896 for instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 on hv-cinder-83979 May 27 19:53:25.185166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-e8f892d6-89a9-4008-984e-5797aa08267a req-d5451acc-f017-4203-94c9-067f3c356563 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 May 27 19:53:25.186023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 270/475] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:25.270888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:25.271496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:25.292132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.292132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.292132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.292132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.311219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:25.312044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:25.318397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:25.321169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.326137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.326137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.326137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.403320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:25.412092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-41d47a08-7e12-4a25-9d11-17ad5925ec5f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1299 microversion: 2.1 time: 0.105851 May 27 19:53:25.413127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 271/476] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:25 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:25.431049 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:25.439754 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:25.441291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:25.443148 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4d9a8f5f-a68d-4dce-9eb6-73995f26684f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.176566 May 27 19:53:25.443741 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 206/477] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:25 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:25.467230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:25.468079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:25.475471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.492307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.492307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.492307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.612183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:25.620845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4e79fc8c-e42d-4fdc-b68f-d606418b337a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.158870 May 27 19:53:25.621587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 272/478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:25 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:25.905768 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:25.906386 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:25.913240 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.918310 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:25.918310 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:25.918310 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.308464 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.315972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6eccfbff-3465-4374-a7f2-bd8f96b5fe6a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1498 microversion: 2.1 time: 0.414002 May 27 19:53:26.322425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 207/479] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:25 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1498 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:26.429588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:26.436194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:26.436770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.437252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.438027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.438462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.462228 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:26.462825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:26.469091 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.469555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.470319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.470752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.470859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.471219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.471666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:26.517205 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.528298 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a1873705-4058-4cd6-9748-17645fa8c3c2 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.102545 May 27 19:53:26.528909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 273/480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:26 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:26.602900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.611410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.612905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.614594 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-40182829-2e09-4dcb-8f29-3dafcfc4acf8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.156636 May 27 19:53:26.615185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 208/481] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:26 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:26.637745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:26.638353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:26.644634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.645124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.645892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:26.646324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:26.779338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:26.787093 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-eb9c616d-9807-4d5e-931c-9fe5bf0b983d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.153185 May 27 19:53:26.787751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 274/482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:26 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:27.130933 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:27.132637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:27.137857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.138779 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.139546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.139979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.166003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:53:27.475171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-527eeac3-82d7-4f83-b950-75f7e7e6f223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 204 len: 0 microversion: 2.1 time: 0.348554 May 27 19:53:27.475848 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 209/483] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:53:27 2022] DELETE /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:53:27.483796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:27.484398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:27.491047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.491490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.492245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.492675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.546899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:27.548564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:27.560759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.561235 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.562096 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.562531 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.594278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.598062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.598062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:27.639593 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.640096 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.647443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5751043a-3188-4948-8db8-96418976331a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.167384 May 27 19:53:27.648018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 275/484] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:27 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:27.648170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-644b595c-d5b9-426b-9d6e-8f64010d9833 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.105389 May 27 19:53:27.649005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 210/485] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:27 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:27.656982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:27.657816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:27.664015 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.664470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.665283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.665718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.799664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.803738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:27.804344 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:27.808024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.809600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.810261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.810707 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.810834 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ef5d73b5-e1f0-4e30-99d2-c8f4eb7f1fdb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160830 May 27 19:53:27.811284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 276/486] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:27 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:27.811471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:27.811907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:27.815945 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:27.941040 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:27.949046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-48fcaa82-60d6-4a67-b773-e4ffdc88b293 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.149307 May 27 19:53:27.949623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 211/487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:27 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:28.665581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:28.666172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:28.666556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:28.666670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:28.672883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.673092 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.673363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.673559 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.674128 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.674326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.674686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.674801 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.705713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.706166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.706622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:28.747832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:28.755505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-88bba210-4a5d-4f55-a39c-fa3a97ae7c8d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.093803 May 27 19:53:28.756081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 277/488] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:28 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:28.806563 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:28.813940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6e89df58-9bfc-4497-996c-e2254b1cbc65 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.152050 May 27 19:53:28.814500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 212/489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:28 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:28.830450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:28.831275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:28.838545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.838996 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.839763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.840199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.966514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:28.967369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:28.971715 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:28.973738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.974404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.975178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:28.975610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:28.980664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:28.982294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:28.983447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-afb76b5d-4873-42f6-8c8d-084f021b15ba tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.158499 May 27 19:53:28.984002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 278/490] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:28 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:29.105511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:29.112880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-29583308-2805-48da-87f9-62a40c4a9559 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.150172 May 27 19:53:29.113461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 213/491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:28 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:29.771960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:29.772559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:29.779031 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:29.779471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:29.780229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:29.780657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:29.812308 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:29.812753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:29.813256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:29.835572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:29.836163 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:29.842942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:29.843391 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:29.844153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:29.844588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:29.855402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:29.863080 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7fa87f29-7343-4b71-803d-2400f5bfd5f8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095427 May 27 19:53:29.863649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 279/492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:29 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:29.972349 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:29.980094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e7c829ea-532a-46a9-94c8-f76052940d05 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.148689 May 27 19:53:29.980652 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 214/493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:29 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:30.001998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:30.002596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:30.009196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.009640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.010389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.010818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.131682 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:30.132285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:30.138588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.139113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.139951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.140397 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.143471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:30.152541 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:30.154064 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:30.155218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ca66cb41-1470-4f9e-bcea-2e41e0dcf459 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.157134 May 27 19:53:30.155800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 280/494] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:29 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:30.269225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:30.276592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-029c704b-6068-47b6-a653-4ef8f3e4250c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.149974 May 27 19:53:30.277353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 215/495] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:30 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:30.881075 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:30.881845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:30.888484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.888930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.889717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.890150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.920848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:30.921327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:30.926929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:30.962212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:30.969795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-049836e6-6a58-4df1-8bfb-e4a112caaf7f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.093202 May 27 19:53:30.970356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 281/496] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:30 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:30.996696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:30.997318 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:31.003717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.004164 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.004923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.005887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.137734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:31.145798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-84abd296-cef7-456b-8529-33bd65bdc98f tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.152839 May 27 19:53:31.151003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 216/497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:30 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:31.172441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:31.173062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:31.179835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.180269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.181049 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.181479 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.292929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:31.293571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:31.299526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.299973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.300766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.301221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.310863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:31.320441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:31.322280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:31.323538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-616a70f7-6fbf-432d-8c39-69a39934a311 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.154905 May 27 19:53:31.324185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 282/498] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:31 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:31.428064 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:31.435482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-71eee304-3ffe-4662-9263-b4162a63218a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.146357 May 27 19:53:31.436120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 217/499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:31 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:31.986321 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:31.986927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:31.993518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.993957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:31.994710 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:31.995136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.024620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.025086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.025524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:32.028100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:32.065766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.073459 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-59ae40a3-07c7-4224-bad2-72022ed06699 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.090911 May 27 19:53:32.074017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 283/500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:31 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:32.167999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:32.168550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:32.175195 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.175638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.176402 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.176837 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.311159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.319105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6842eef5-c577-4b93-a9d1-29748e5b1f2c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.155379 May 27 19:53:32.319672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 218/501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:32 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:32.340994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:32.341609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:32.347941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.348391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.349348 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.349810 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.453627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:32.454227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:32.460731 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.461197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.461956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:32.462383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:32.484758 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.493369 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.494862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.496006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ac675db6-5b73-4972-ad1a-b084a9638321 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.159020 May 27 19:53:32.496569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 284/502] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:32 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:32.589995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:32.597542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-efcfc203-19a4-41cc-a385-10d69a8508a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.148306 May 27 19:53:32.598098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 219/503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:32 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:33.089779 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:33.090301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:33.097077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.099524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.099524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.099524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.130141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.130666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.131111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:33.171661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.180226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-908ae2fe-39c7-4316-829a-e8e3288f90e6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.094414 May 27 19:53:33.180794 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 285/504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:33 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:33.335871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:33.336467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:33.343389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.343796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.344549 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.344994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.476529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.483937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f2e841bd-bb0f-4b49-9cf3-90a3b6a71211 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.152327 May 27 19:53:33.484506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 220/505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:33 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:33.514840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:33.515443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:33.522044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.523474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.524244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.524673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.614163 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:33.615462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:33.621590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.621964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.622715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:33.623153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:33.661766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.670481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.671985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.673190 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-204452ac-231d-4c3e-9f4d-512dc3109bbe tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.162253 May 27 19:53:33.673750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 286/506] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:33 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:33.756132 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:33.763522 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ee3b1913-d893-4e1f-9662-bcd9984eec0a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.153212 May 27 19:53:33.764082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 221/507] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:33 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:34.197092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:34.197719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:34.204385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.204836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.205664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.206102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.236853 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.237328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.237772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:34.280327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.288609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1fc5d380-7a16-4b0d-b5ae-8dc1fe02b43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095515 May 27 19:53:34.290084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 287/508] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:34 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:34.500994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:34.501605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:34.509027 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.509472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.510237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.510664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.637195 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.644585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b2e9c8ad-94ed-4de6-8c21-87cf3b42dc0e tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.147449 May 27 19:53:34.645322 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 222/509] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:34 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:34.696107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:34.702069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:34.703047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.703526 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.704295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.704727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.779353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:34.779876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:34.785789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.786230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.787436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:34.787871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:34.839840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.848587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.850250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.851514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5c57df25-ad47-4469-9642-e144e95700c7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.161676 May 27 19:53:34.852080 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 288/510] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:34 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:34.919824 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:34.927357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-58d80259-4c45-451b-b4e5-f3c54e504e7b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.151930 May 27 19:53:34.927917 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 223/511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:34 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:35.305680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:35.306293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:35.312894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.313376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.314140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.314581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.347103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.347559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.348010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:35.389314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:35.397633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-aa67c6d1-d5c7-4d76-918c-7630fc06a942 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.096013 May 27 19:53:35.398194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 289/512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:35 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:35.662253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:35.662856 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:35.669401 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.669918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.670694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.671118 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.801796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:35.809905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-852c4b14-cfb2-4dc8-85bb-7a06b216c149 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.151737 May 27 19:53:35.810475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 224/513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:35 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:35.870473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:35.871021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:35.877205 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.877649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.878402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.878830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.944249 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:35.944858 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:35.950899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.951350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:35.952151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:35.952587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.013477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.021967 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.023485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.024656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a743b853-60d8-407b-b4da-3f77f1a81d27 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.158172 May 27 19:53:36.025324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 290/514] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:35 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:36.086941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.094630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4a6a76b8-ba58-42f9-8879-b22560b2d1d5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.154935 May 27 19:53:36.095196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 225/515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:35 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:36.299380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:36.299862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.306465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.307018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.307645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.308071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.331559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6cad429f-99ec-4a3e-81cc-ef462655b7cf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/ips" status: 200 len: 150 microversion: 2.1 time: 0.036267 May 27 19:53:36.332109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 291/516] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:53:36 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:36.343074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4ed7997-d1ab-4b47-a6d9-21e9cf522267"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:36.344185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.350857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.351304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.352065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.352504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.415700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:36.416349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.422685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.423130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.423878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.424307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.435302 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: POST /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/os-volume_attachments HTTP/1.1 May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 74 May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:53:36.437035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {"volumeAttachment": {"volumeId": "d4ed7997-d1ab-4b47-a6d9-21e9cf522267"}} May 27 19:53:36.438532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'server_id': '87a8e8f6-08f1-4ac5-beae-03501818ff8f', 'body': {'volumeAttachment': {'volumeId': 'd4ed7997-d1ab-4b47-a6d9-21e9cf522267'}}} May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:36.439312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:36.440503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 400 to user: Invalid volume: volume d4ed7997-d1ab-4b47-a6d9-21e9cf522267 is already attached to instances: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-92d5522d-6597-4784-b18b-7f835cf0f2ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099731 May 27 19:53:36.443149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 226/517] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:53:36 2022] POST /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 19:53:36.447588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:36.448076 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.454008 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.454973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.455742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.456173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.456868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.457346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.457782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:36.482015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:53:36.484824 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:36.498575 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.506447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-96289534-d073-4b28-a062-6de5088a76d3 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095974 May 27 19:53:36.507015 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 292/518] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:36 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:36.719631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ff767886-a471-47f5-ad3f-28494ecd7a6f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 204 len: 0 microversion: 2.1 time: 0.275991 May 27 19:53:36.720205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 227/519] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:53:36 2022] DELETE /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 19:53:36.728858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:36.730401 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.735484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.735926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.736678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.737135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.828096 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:36.832338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:36.835650 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.836101 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.836876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:36.837336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:36.867964 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.873914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b281bd32-72d5-4ab6-a48e-7ffe1f011dfd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.148780 May 27 19:53:36.874492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 293/520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:36 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:36.972185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:36.979692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e799a605-1f41-4ec8-b6a5-7213dc640c63 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.155795 May 27 19:53:36.980265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 228/521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:36 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:37.042027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:37.042625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:37.048657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.049137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.049890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.050319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.111422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:37.112031 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:37.118790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.119245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.120015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.120450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.186307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:37.195728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:37.197305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:37.198477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-88fb2a97-e27a-4a01-a225-93324911e0cd tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160351 May 27 19:53:37.199035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 294/522] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:37 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:37.250782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:37.259299 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-58f7563f-9ec4-4eb0-b21f-ceff39e1a16a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.151740 May 27 19:53:37.259874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 229/523] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:37 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:37.523887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:37.524521 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:37.530980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.531423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.532178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.532610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.564902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.565456 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.565892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:37.606998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:37.614368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bc8150ff-b1c0-4aa9-8fd7-f5554dbc7a4b tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095068 May 27 19:53:37.614940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 295/524] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:37 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:37.891425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:37.892016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:37.898290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.898735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.899493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:37.899924 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:37.996680 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:37.997309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:38.003311 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.003751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.004498 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.005843 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.087213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.101589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9db15b0d-b948-487b-baef-5bcb76a61c35 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.213725 May 27 19:53:38.102505 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 230/525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:37 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:38.141798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.150027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3797fd37-f85c-4b27-b848-f419227fccc5 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.157265 May 27 19:53:38.150590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 296/526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:37 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:38.217315 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:38.217914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:38.224802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.225367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.226137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.226575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.280578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:38.281301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:38.288220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.288670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.289466 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.289892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.361665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.370371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.371885 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.373091 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d417e56f-d0b6-4d64-a1ae-d7369ae05283 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.159924 May 27 19:53:38.373648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 231/527] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:38 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:38.422901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.431056 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a14dc0cd-8dd6-4278-bbcc-e96a9f39d99f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.154328 May 27 19:53:38.431622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 297/528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:38 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:38.631742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:38.632264 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:38.638325 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.638772 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.639520 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.639948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.672466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:38.672908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:38.673375 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:38.717724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:38.725799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6b203bfa-7b39-4f49-b0e0-804926739099 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.098753 May 27 19:53:38.726360 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 232/529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:38 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:39.120168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:39.120808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:39.127371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.127816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.128574 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.129035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.166664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:39.167259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:39.173910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.174357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.175120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.175548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.259924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.263338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:39.268361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cdc3ae4c-ddb9-41f5-8468-265e32c53bcd tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.152018 May 27 19:53:39.268937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 298/530] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:39 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:39.307942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.315330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1fdf0d4a-dbba-4ce4-994b-8e720357f631 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.152434 May 27 19:53:39.315890 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 233/531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:39 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:39.392011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:39.392573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:39.398768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.399212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.399970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.400403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.448115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:39.448827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:39.454840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.455285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.456045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.456476 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.533278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.542001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.543503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.544676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f0aadfd9-27e8-42ac-946f-c56679d7e8c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.157081 May 27 19:53:39.545280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 299/532] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:39 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:39.586489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.594228 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ba442742-30a3-4efe-957b-dcc4f9663754 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.150018 May 27 19:53:39.594781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 234/533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:39 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:39.743279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:39.743907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:39.749973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.750424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.751182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.751620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.781364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:39.781808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:39.782247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:39.822705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:39.830497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3b2c7616-6a7c-40dd-8b80-ea98e82eba93 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.091894 May 27 19:53:39.849400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 300/534] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:39 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:40.286151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:40.287305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:40.293870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.297564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.297564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.297564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.333591 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:40.334576 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:40.341421 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.342123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.342890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.343320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.429293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.437335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7182f2e9-8b7a-4eb6-8c74-e26b4ad98040 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.154917 May 27 19:53:40.440152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 235/535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:40 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:40.473243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.482062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f7ebeb9d-6770-4308-93e2-9439da9c6e89 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.152865 May 27 19:53:40.482691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 301/536] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:40 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:40.563911 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:40.564511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:40.571418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.571886 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.572619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.573088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.610138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:40.610750 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:40.617414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.617871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.618645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.619079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.710617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.720161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.721922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.723076 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8502d382-d0ce-4f1b-b462-fd561c615be0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.163051 May 27 19:53:40.723995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 236/537] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:40 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:40.762867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.770345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b03e6ba3-2b44-4e7e-9029-2a6fe9c58910 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.163937 May 27 19:53:40.771830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 302/538] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:40 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:40.864219 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:40.865026 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:40.870974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.871392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.872142 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.872569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.903144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:40.903608 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:40.904046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:40.944215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:40.951529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-394850da-6c0e-43ab-8db1-f756e9775e2f tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.091193 May 27 19:53:40.952078 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 237/539] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:40 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:41.455150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:41.455757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:41.463000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.463477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.464264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.464691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.499683 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:41.500289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:41.503937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:41.511845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.512287 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.513111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.513546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.597300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.605210 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5e5e77fb-b950-4144-9099-9f8437825503 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.153873 May 27 19:53:41.605859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 303/540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:41 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:41.650686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.657983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6f910d81-749d-4b90-b370-b2aaf1fe5f0a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.162351 May 27 19:53:41.658575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 238/541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:41 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:41.741383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:41.741917 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:41.747888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.748334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.749125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.749675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.788261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:41.788865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:41.794964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.795416 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.796186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.796620 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.879016 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.887770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.889320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.890544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-883de311-9360-4b27-b1b7-c80b255d99b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.153514 May 27 19:53:41.891467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 304/542] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:41 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:41.932816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:41.940241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dcb766f2-0a26-4881-86b8-6d9cbb66e6e8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.156682 May 27 19:53:41.940796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 239/543] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:41 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:41.969133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:41.969743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:41.976685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.977172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:41.977968 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:41.978403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.013119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.013119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.013447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:42.057403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:42.064883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e2d983a3-a457-4b87-bbb8-b44ac8089943 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.099830 May 27 19:53:42.067251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 305/544] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:41 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:42.622819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:42.623380 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:42.630089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.634108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.634108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.634108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.675690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:42.676276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:42.682791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.683232 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.683991 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.684422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.773891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:42.781636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5518342a-dd9d-4224-80aa-b49b2f0e037b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.162728 May 27 19:53:42.782620 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 240/545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:42 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:42.821485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:42.829176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8cc14db6-a0a3-489a-b5dd-6a68b021271c tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.157290 May 27 19:53:42.829744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 306/546] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:42 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:42.909089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:42.909606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:42.915643 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.916086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.916832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.917293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.957133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:42.957734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:42.964366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.964803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:42.965601 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:42.966032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.051488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.060244 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.061774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.062922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a320f1ce-3728-4664-ad13-64d14e7b8854 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.157824 May 27 19:53:43.063472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 241/547] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:42 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:43.082267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:43.083667 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.090207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.090644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.091410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.092090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.096109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:43.107727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.115748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5b339902-d56a-4df5-abfa-c11fa91971ac tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1501 microversion: 2.1 time: 0.162359 May 27 19:53:43.116328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 307/548] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:42 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:43.129364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.130650 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.131530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:43.132651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11c65f47-58b5-474d-9bd6-376c492b1414"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:43.133810 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.139799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.140385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.141198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.141640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.165728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] HTTP exception thrown: Cannot 'attach_volume' instance d81fcd54-4eed-417b-bd06-11187de21f7d while it is in vm_state rescued May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Request method failure captured: May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/os-volume_attachments HTTP/1.1 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 74 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSvN-7XXjSH7cWkPu1kJRy1a-_svyOKCeQu57zkfa_0KkJ9ATvvYtFztWlGhENwRPv5g1Z8IyfwdHWfbFAtDcnGJZfU5N8fICy34QpfXtXZR83qv8i4QDM3or5ds5dfkISvzGf06rPDDL07QqGHU1PUNUHQz9NOP2YfFxGgeRiIXldk May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:53:43.167542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3388fd386824477385e3ad6baa4cae56", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3388fd386824477385e3ad6baa4cae56"}]}] May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: a13d2c50c5204c859872e99bc45c6566 May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {"volumeAttachment": {"volumeId": "11c65f47-58b5-474d-9bd6-376c492b1414"}} May 27 19:53:43.169116 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Cannot 'attach_volume' instance d81fcd54-4eed-417b-bd06-11187de21f7d while it is in vm_state rescued May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'server_id': 'd81fcd54-4eed-417b-bd06-11187de21f7d', 'body': {'volumeAttachment': {'volumeId': '11c65f47-58b5-474d-9bd6-376c492b1414'}}} May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d81fcd54-4eed-417b-bd06-11187de21f7d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:53:43.170269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d81fcd54-4eed-417b-bd06-11187de21f7d while it is in vm_state rescued May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:43.171855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d81fcd54-4eed-417b-bd06-11187de21f7d while it is in vm_state rescued May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Returning 409 to user: Cannot 'attach_volume' instance d81fcd54-4eed-417b-bd06-11187de21f7d while it is in vm_state rescued {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c104583b-fe1e-43f4-9a1c-b5af83f70d79 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041003 May 27 19:53:43.173609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 308/549] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:53:43 2022] POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 27 19:53:43.178331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.180288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:43.180288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.182389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:43.185665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1ccab8e6-4aab-4de2-99f4-7801b4545b30 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.107143 May 27 19:53:43.185814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.186222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.186364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 242/550] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:43 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:43.186979 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.187409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.328218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2c6eb710-39c3-4fd4-80e0-295fc6d0a8a5 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/action" status: 202 len: 0 microversion: 2.1 time: 0.154008 May 27 19:53:43.328839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 309/551] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:53:43 2022] POST /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 19:53:43.337293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:43.338033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.344659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.345133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.345896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.346330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.477353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.484751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-46732499-49ba-4705-a1a7-73ad470db43f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.151749 May 27 19:53:43.485349 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 243/552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:43 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:43.800377 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:43.803845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.813371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.816636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.817745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.818391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.850364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:43.851408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:43.859777 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.860233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.861047 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:43.866715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:43.961782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:43.970032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-20f4e682-df9f-4a2a-a917-6154ccc8e77e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.174773 May 27 19:53:43.970598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 310/553] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:43 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:44.003790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.011504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-52683599-57b1-44af-88fd-eff63055e08a tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.167623 May 27 19:53:44.012059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 244/554] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:43 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:44.081826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:44.082356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:44.088836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.089332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.090112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.090546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.204862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:44.205589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:44.212359 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.215284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.215284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.215284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.222700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.232196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.233767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.234920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d4bef5a5-8955-4795-babc-65ddcf7bd7f1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.157007 May 27 19:53:44.235673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 311/555] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:44 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:44.245579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.246033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.246482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:44.287270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.294705 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1c8ef73f-4545-4451-827b-bc6c502e6bd6 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095114 May 27 19:53:44.295269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 245/556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:44 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:44.502599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:44.503202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:44.509941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.510387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.511148 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.511587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.642099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:44.649578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f1d96688-2c14-4704-9aef-510e9db6de82 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.150800 May 27 19:53:44.650129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 312/557] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:44 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:44.988104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:44.988753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:44.995997 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.996585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:44.997377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:44.997936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.029316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:45.029929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:45.037110 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.037972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.038599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.039147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.136166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.143966 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b79a5403-568b-4739-b34f-19842678cdfc tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.159619 May 27 19:53:45.146990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 246/558] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:44 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:45.177180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.184597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-60e7d3ca-9abd-4ba6-8a4f-f8b77f7c7035 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.159286 May 27 19:53:45.185192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 313/559] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:45 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:45.253419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:45.254478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:45.260727 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.261229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.262110 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.262538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.311527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:45.312453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:45.318777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.319301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.320280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.320907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.325291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:45.354815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.355459 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.355914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:45.397838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.406463 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.408212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.408929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.409981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-98971346-7978-4ff2-9c8b-b74e3d6e0059 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160842 May 27 19:53:45.411124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 247/560] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:45 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:45.426725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5ccbc425-89e8-4f94-aa9e-905d39b41a9e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.118976 May 27 19:53:45.428111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 314/561] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:45 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:45.667392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:45.668004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:45.674020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.674465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.675227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:45.675658 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:45.835659 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:45.843271 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e51a1b29-47be-478e-9ff8-3514150a3ad3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.179753 May 27 19:53:45.843820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 248/562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:45 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:46.162936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:46.163492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:46.171795 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.172249 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.173071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.173515 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.203342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:46.203955 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:46.214907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.215362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.216181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.216881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.363597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.372038 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f53e4c29-959b-46c7-bb9d-b7f3ca7a2d7e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.213493 May 27 19:53:46.372620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 315/563] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:46 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:46.382698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.390221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f8fd315b-6886-4ce1-bf02-dd203e8f0223 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.190786 May 27 19:53:46.390769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 249/564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:46 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:46.427672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:46.428334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:46.434300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.434738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.435492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.435924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.444678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:46.445413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:46.451503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.452030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.452882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.453432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.485330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.485777 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.486223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:46.531421 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.538962 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0a304c4a-602d-4553-bfa8-27b8c91ed76c tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.098965 May 27 19:53:46.540051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 250/565] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:46 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:46.571303 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.579726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.581245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:46.582389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2818aa89-27c2-4a37-b1b2-7ec1a62e34a7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.158832 May 27 19:53:46.582950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 316/566] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:46 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:46.860519 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:46.861157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:46.867711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.868146 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.868895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:46.869346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:46.997947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.006106 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-208ae8da-6043-442c-8de4-e81791823c8a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.148741 May 27 19:53:47.006753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 251/567] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:46 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:47.388480 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:47.389121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:47.395611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.397524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.397524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.397524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.408839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:47.409471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:47.416636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.417125 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.417894 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.418326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.530261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.538129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0967c084-0c13-4a7e-a89e-a5814d91c020 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.153427 May 27 19:53:47.538696 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 317/568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:47 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:47.555021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.556982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:47.557862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:47.563028 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a18fbd8a-02c4-4889-be65-2e0075a30684 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.158019 May 27 19:53:47.563622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 252/569] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:47 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:47.563890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.564422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.565215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.565650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.596375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.596854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.597323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:47.601661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:47.602263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:47.608135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.608583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.609379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:47.609815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:47.638306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.646432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ba79ecd3-8550-43a5-b3f8-6ea0389e84c1 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.093876 May 27 19:53:47.646933 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 318/570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:47 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:47.744231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.752636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.754152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:47.755968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-cde208da-9435-4cc7-bf13-23f2014e99bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.157989 May 27 19:53:47.756519 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 253/571] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:47 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:48.023105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:48.023717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:48.029838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.030282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.031045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.031481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.164604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.172180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f44621a3-1291-481e-b7c6-461758577eae tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.153021 May 27 19:53:48.172748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 319/572] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:48 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:48.556011 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:48.556606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:48.563190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.563631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.564380 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.564807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.580044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:48.580645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:48.587345 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.587856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.588630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.589086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.696712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.704176 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-08188153-bc4f-47b6-8ab4-f7756360e9de tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.152586 May 27 19:53:48.704742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 254/573] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:48 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:48.709167 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:48.709866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:48.715696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.716143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.717195 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.717625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.718404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.726628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-338e99fa-e1e2-4c59-b5a1-7ed5d1acbc39 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.150389 May 27 19:53:48.727194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 320/574] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:48 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:48.749690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.750133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.750572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:48.774362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:48.775016 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:48.781953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.782398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.783169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:48.783599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:48.795559 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.804010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-06e15abd-9bc7-4fa7-87c5-f715d910c21e tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.098164 May 27 19:53:48.804630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 255/575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:48 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:48.917289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.925671 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.927317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:48.929302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-02f81e27-05e6-46d7-bf69-42248dc5a7b2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.158847 May 27 19:53:48.929864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 321/576] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:48 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:49.188978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:49.189580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:49.195695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.196137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.196895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.197356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.324331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:49.331870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2afb4f96-9cc0-42a8-b503-a5b2b77adc13 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.146818 May 27 19:53:49.332432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 256/577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:49 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:49.721777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:49.722414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:49.728865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.729340 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.730092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.730520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.743754 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:49.744353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:49.750816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.751259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.752017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.752449 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.771352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:49.864595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:49.873047 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4a04c8a4-8024-4bef-9f00-9f988322b640 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.154985 May 27 19:53:49.873543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 322/578] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:49 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:49.878089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:49.878686 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:49.885628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.886002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.886768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.887198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.887810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:49.895210 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-910beb7e-3545-43c6-bb5d-b47b605474ec tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.155513 May 27 19:53:49.895773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 257/579] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:49 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:49.919045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.919482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.919924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:49.948527 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:49.949165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:49.955192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.955641 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.956408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:49.956845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:49.961644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:49.969828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-af21b0e3-ea9b-49ff-8e1c-d76ef634f621 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.095345 May 27 19:53:49.970391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 323/580] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:49 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:50.087548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:50.096145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:50.097689 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:50.098838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-56bc09e9-5e95-4d9d-bd51-934f3c1d41f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.155217 May 27 19:53:50.099399 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 258/581] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:49 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:50.351094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:50.351642 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:50.357675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.358125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:50.358876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.359303 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:50.487679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:50.495777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1047168a-4791-4dff-abfa-2267884de42a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.149581 May 27 19:53:50.496347 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 324/582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:50 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:50.891534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:50.892137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:50.899489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.899937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:50.900696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.901159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:50.915362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:50.921742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:50.922457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.922851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:50.923608 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:50.924042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.031227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.039205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-776d75ba-5741-4b62-a4a3-e601b6491f25 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.151475 May 27 19:53:51.039775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 259/583] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:50 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:51.044173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:51.044774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:51.050548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.050995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.051757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.052188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.057109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.064486 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b4aa2080-b22a-4de3-a988-1dc164c5aed8 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.153444 May 27 19:53:51.065072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 325/584] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:50 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:51.083135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.083585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.084226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:51.117538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:51.118130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:51.124290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.124743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.125267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.125545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.125986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.133141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1f227aae-8057-4665-a55b-9190f5da7885 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.092356 May 27 19:53:51.133708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 260/585] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:51 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:51.255657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.264077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.265601 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.266744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-25c39b25-b0cd-49b5-a62c-79a511489082 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.153807 May 27 19:53:51.267323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 326/586] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:51 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:51.513311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:51.513627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:51.519691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.520138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.520900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:51.521853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:51.651791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:51.659233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5450abb3-bc1b-415e-aa3b-17de573755a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.150143 May 27 19:53:51.659832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 261/587] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:51 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:52.057010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:52.057622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:52.064255 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.064699 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.065491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.065949 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.081484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:52.082106 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:52.089083 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.089528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.090279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.090717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.199953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.207543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7a5b8dae-6740-4404-a10b-7732fa2556b5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.155127 May 27 19:53:52.208113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 327/588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:52 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:52.212687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:52.213312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:52.219405 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.219898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.220734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.221202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.224629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.232234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-68f9d0da-cfd2-4d66-8f17-4f693a1d8379 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.154536 May 27 19:53:52.233019 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 262/589] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:52 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:52.254146 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.254603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.255057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:52.285344 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:52.285937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:52.292290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.292733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.293522 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.293947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.295975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.304068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8f81551d-4727-4007-88c0-ae080802a43a tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.094990 May 27 19:53:52.304769 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 328/590] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:52 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:52.424638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.433737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.435255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.436411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2d119e35-b47f-4a36-bf7b-6241dd70a6bb tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.154933 May 27 19:53:52.436977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 263/591] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:52 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:52.676402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:52.676983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:52.683583 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.684023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.684787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.685228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.703726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=100 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:52.816363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:52.823975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f1bf1134-fed7-45b2-b4c4-d72f6f6febaf tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.151479 May 27 19:53:52.824543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 329/592] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:52 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:52.916523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-40b1f001-62f0-431b-a3ed-fe5515757c3b req-a1e002d4-5dcd-4a74-bdc6-14e1abc9d2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a8e8f6-08f1-4ac5-beae-03501818ff8f", "name": "network-vif-unplugged", "status": "completed", "tag": "d371d39e-9fa3-40f7-80a7-99cd4a49eb25"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:52.925030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-40b1f001-62f0-431b-a3ed-fe5515757c3b req-a1e002d4-5dcd-4a74-bdc6-14e1abc9d2b0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:52.925469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-40b1f001-62f0-431b-a3ed-fe5515757c3b req-a1e002d4-5dcd-4a74-bdc6-14e1abc9d2b0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:52.940505 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-40b1f001-62f0-431b-a3ed-fe5515757c3b req-a1e002d4-5dcd-4a74-bdc6-14e1abc9d2b0 service nova] Creating event network-vif-unplugged:d371d39e-9fa3-40f7-80a7-99cd4a49eb25 for instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f on hv-cinder-83979 May 27 19:53:52.941478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-40b1f001-62f0-431b-a3ed-fe5515757c3b req-a1e002d4-5dcd-4a74-bdc6-14e1abc9d2b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029209 May 27 19:53:52.942066 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 264/593] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:53.225109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:53.225719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:53.232162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.232612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.233399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.233834 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.251243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:53.251948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:53.258989 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.259478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.260240 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.260673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.401360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.408926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7ef788d2-577e-4825-b17c-17215bf32d5b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.187897 May 27 19:53:53.409513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 330/594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:53 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:53.414378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:53.414978 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:53.423262 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.423461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.423901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.424664 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.425142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.431327 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b2d0702d-f04b-4693-8688-0872e309dd80 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.185831 May 27 19:53:53.432059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 265/595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:53 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:53.453927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:53.454558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:53.460878 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.461188 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.461346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.461637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.462083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:53.462209 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.462509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.503391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.512393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7ec071c2-7817-49c2-811e-2c18f663e420 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.101843 May 27 19:53:53.512999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 331/596] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:53 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:53.599436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.607866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.609395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.610536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c21f7eb3-a92b-4182-8fdc-e99ad6f69897 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160506 May 27 19:53:53.611097 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 266/597] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:53 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:53.841534 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:53.842297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:53.848665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.850812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.850812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:53.850812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:53.982553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:53.990019 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bacd9e07-f025-4573-b6d5-a221d7b079fa tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.152789 May 27 19:53:53.990577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 332/598] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:53 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:54.434346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:54.436103 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:54.447558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:54.448410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:54.449242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.450333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.452104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.459292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.460467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.460861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.463787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.464262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.709092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:54.717368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-af921046-91ee-4951-a4e9-94bc4939c6be tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1504 microversion: 2.1 time: 0.273564 May 27 19:53:54.717940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 333/599] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:54 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:54.722666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:54.723268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:54.730043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.730493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.731258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.731691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.763091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.763542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.763988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lazy-loading 'fault' on Instance uuid 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:54.805165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7870acb5f8b447e8ebb86eaa2ecfcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ab6f56bbb34547a1fa2548159e7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:54.813120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-64effe3c-0d23-475b-baeb-94e5f2587b9d tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 200 len: 1304 microversion: 2.1 time: 0.093891 May 27 19:53:54.813887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 334/600] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:54 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:54.819451 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:54.820259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:54.826574 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.827055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.827823 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:54.828258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:54.856515 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:54.893030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b880be1c-c038-4d4e-a78a-1e42629ac0fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1682 microversion: 2.1 time: 0.451278 May 27 19:53:54.893030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 267/601] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:54 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1682 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:54.991111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-ac7b987a-0ce6-4425-88c6-7bcdaf59af42 req-52ec6e32-2594-4cc8-b0c3-148d1ae4b90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0", "name": "network-vif-unplugged", "status": "completed", "tag": "a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:55.016994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-ac7b987a-0ce6-4425-88c6-7bcdaf59af42 req-52ec6e32-2594-4cc8-b0c3-148d1ae4b90a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.018588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-ac7b987a-0ce6-4425-88c6-7bcdaf59af42 req-52ec6e32-2594-4cc8-b0c3-148d1ae4b90a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.036442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-ac7b987a-0ce6-4425-88c6-7bcdaf59af42 req-52ec6e32-2594-4cc8-b0c3-148d1ae4b90a service nova] Creating event network-vif-unplugged:a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf for instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 on hv-cinder-83979 May 27 19:53:55.044054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-ac7b987a-0ce6-4425-88c6-7bcdaf59af42 req-52ec6e32-2594-4cc8-b0c3-148d1ae4b90a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058086 May 27 19:53:55.045629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 268/602] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:55.052841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:55.054612 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:55.061750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.062520 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.063674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.064357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.168250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.179126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.180865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.182225 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9c1be747-de60-425e-9643-aa92b2beed29 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.367158 May 27 19:53:55.209900 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 335/603] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:54 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:55.388729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.398562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ff3022b8-ba93-4bdd-9326-f1b1f00c9399 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.351298 May 27 19:53:55.399520 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 269/604] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:55 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:55.645493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:55.646111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:55.653513 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.653975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.654809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.655463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.656970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-bf30a1e9-e262-4e58-b3d2-0e126184e6a4 req-a6d94755-ebfb-4b93-b56e-34af8fd32426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0", "name": "network-vif-deleted", "tag": "a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:55.671480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-bf30a1e9-e262-4e58-b3d2-0e126184e6a4 req-a6d94755-ebfb-4b93-b56e-34af8fd32426 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.671970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-bf30a1e9-e262-4e58-b3d2-0e126184e6a4 req-a6d94755-ebfb-4b93-b56e-34af8fd32426 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.686827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-bf30a1e9-e262-4e58-b3d2-0e126184e6a4 req-a6d94755-ebfb-4b93-b56e-34af8fd32426 service nova] Creating event network-vif-deleted:a90eb90b-c1a3-48bc-9c13-21e1cf0dfbcf for instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 on hv-cinder-83979 May 27 19:53:55.692436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-bf30a1e9-e262-4e58-b3d2-0e126184e6a4 req-a6d94755-ebfb-4b93-b56e-34af8fd32426 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040142 May 27 19:53:55.693236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 270/605] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:55.735899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:55.736859 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:55.745463 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.745910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.746679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.747115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.821069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.829196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-817d3d4d-2294-4605-babd-cfbc44d43695 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1594 microversion: 2.1 time: 0.187562 May 27 19:53:55.829773 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 336/606] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:55 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1594 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:55.836400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:55.847407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:55.848909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] [instance: 02a84a5f-07f5-4c8f-9ded-910a7cde6e63] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:55.851015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5e14bab1-1197-4dca-9c8a-2cc62ab0fa66 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1462 microversion: 2.1 time: 0.118817 May 27 19:53:55.851978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 271/607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:55 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:55.864882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.865374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.866927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.866927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.883465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] HTTP exception thrown: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Request method failure captured: May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 HTTP/1.1 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSv_4lNL52yoxyhXQHBq_znSc9Q5oAye_p_HuUw1m2PRMctP4iYvY_rsRIXsZ2aQhd-m0hGPCk1wlMiqgNfBTttBvUR9B3R4zw-v6_bmwuVEIsZ5ddu3A-v645U--e3fxWIRnDB_HinETcrodiJYlWStRmJCQ19SlUr1h6_80O6s9dE May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 96ab6f56bbb34547a1fa2548159e7579 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesNegativeTest-1141624570 May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:53:55.885761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96ab6f56bbb34547a1fa2548159e7579"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/96ab6f56bbb34547a1fa2548159e7579"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_96ab6f56bbb34547a1fa2548159e7579", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/96ab6f56bbb34547a1fa2548159e7579"}]}] May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesNegativeTest-1141624570 May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 96ab6f56bbb34547a1fa2548159e7579 May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesNegativeTest-1141624570 May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesNegativeTest-1141624570-project May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: f7870acb5f8b447e8ebb86eaa2ecfcfa May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesNegativeTest-1141624570-project May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. May 27 19:53:55.887224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '02a84a5f-07f5-4c8f-9ded-910a7cde6e63'} May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:53:55.888629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. May 27 19:53:55.890099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:55.891197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] Returning 404 to user: Instance 02a84a5f-07f5-4c8f-9ded-910a7cde6e63 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:53:55.891197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-aa2f8fdd-34c8-4ba9-ac9b-a7bbabe87dd8 tempest-VolumesNegativeTest-1141624570 tempest-VolumesNegativeTest-1141624570-project] 10.222.0.13 "GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63" status: 404 len: 111 microversion: 2.1 time: 0.055307 May 27 19:53:55.891197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 337/608] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:55 2022] GET /compute/v2.1/servers/02a84a5f-07f5-4c8f-9ded-910a7cde6e63 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:53:55.905966 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:55.906692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:55.914312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.914848 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:55.915940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:55.916445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.219063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:56.227091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:56.227746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:56.234846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.235244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.236232 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.236764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.238532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c87314b4-8d4f-4251-8ce9-fdb5c1cbdb1c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1614 microversion: 2.1 time: 0.338162 May 27 19:53:56.239141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 272/609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:55 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1614 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:56.416350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:56.417338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:56.430191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.431157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.433071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.433856 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.523944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:56.534944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:56.536460 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:56.539811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-21dc6230-6594-4d10-ae31-0eb751d53d00 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.328207 May 27 19:53:56.545402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 338/610] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:56 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:53:56.647364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:56.657498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-65d4fb9d-2938-40fe-9d20-4d36f3868270 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1509 microversion: 2.1 time: 0.245734 May 27 19:53:56.667801 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 273/611] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:56 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:53:56.867788 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:56.868400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:56.880177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.881311 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:56.883120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:56.883573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.051183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:57.061622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-78ec7152-9ef2-4960-b0d6-ab464a499dfa tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1299 microversion: 2.1 time: 0.197898 May 27 19:53:57.061829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-6a1b3d2a-f611-4c12-aa8a-8c9d9408b962 req-3bddb869-b485-4566-a663-ff73ed5132ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "name": "network-vif-plugged", "status": "completed", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:57.062670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 339/612] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:56 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:57.076791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-6a1b3d2a-f611-4c12-aa8a-8c9d9408b962 req-3bddb869-b485-4566-a663-ff73ed5132ed service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.077337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-6a1b3d2a-f611-4c12-aa8a-8c9d9408b962 req-3bddb869-b485-4566-a663-ff73ed5132ed service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.091925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-6a1b3d2a-f611-4c12-aa8a-8c9d9408b962 req-3bddb869-b485-4566-a663-ff73ed5132ed service nova] Creating event network-vif-plugged:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:53:57.109395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-6a1b3d2a-f611-4c12-aa8a-8c9d9408b962 req-3bddb869-b485-4566-a663-ff73ed5132ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051210 May 27 19:53:57.117371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 274/613] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:53:57.258354 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:57.259090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:57.266163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.267035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.272537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.277088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.361024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.362559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.363416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'fault' on Instance uuid 87a8e8f6-08f1-4ac5-beae-03501818ff8f {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:57.499997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:57.517474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d652a014-e924-444d-8cca-2142b143467b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1331 microversion: 2.1 time: 0.265662 May 27 19:53:57.518063 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 340/614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:57 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1331 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:57.560450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:57.561186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:57.575981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.576428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.577910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.578554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.675107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:57.675789 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:57.682938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.688175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.689914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.692883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.896100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:57.908925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:57.910677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:57.922971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-38775936-084d-4f96-bcef-65a4274cbdee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.356582 May 27 19:53:57.922971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 275/615] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:57 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:57.922971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-ce9142a5-ecf9-4e7d-9cc1-60cf3b1f1b25 req-b9958575-2114-4c40-8b28-4d301d74fe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87a8e8f6-08f1-4ac5-beae-03501818ff8f", "name": "network-vif-deleted", "tag": "d371d39e-9fa3-40f7-80a7-99cd4a49eb25"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:57.926871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-ce9142a5-ecf9-4e7d-9cc1-60cf3b1f1b25 req-b9958575-2114-4c40-8b28-4d301d74fe6e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:57.927321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-ce9142a5-ecf9-4e7d-9cc1-60cf3b1f1b25 req-b9958575-2114-4c40-8b28-4d301d74fe6e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:57.941106 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-ce9142a5-ecf9-4e7d-9cc1-60cf3b1f1b25 req-b9958575-2114-4c40-8b28-4d301d74fe6e service nova] Creating event network-vif-deleted:d371d39e-9fa3-40f7-80a7-99cd4a49eb25 for instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f on hv-cinder-83979 May 27 19:53:57.948640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-ce9142a5-ecf9-4e7d-9cc1-60cf3b1f1b25 req-b9958575-2114-4c40-8b28-4d301d74fe6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034590 May 27 19:53:57.957460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 276/616] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:58.020409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:58.030189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7dedb9f5-429a-4864-a9af-d3c27d3cd9c6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1515 microversion: 2.1 time: 0.359249 May 27 19:53:58.032147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 341/617] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:57 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:58.080845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:58.081660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:58.091583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.100111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.101073 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.101583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.106521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:58.184363 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.186730 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.191888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lazy-loading 'fault' on Instance uuid 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:58.273364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d3494760b84bc1aad951bba11caea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729158c0db83438a9b762aae3f0009a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:58.281045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2a252f75-b487-4cb4-be59-4ba95b9781c3 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 200 len: 1304 microversion: 2.1 time: 0.204564 May 27 19:53:58.282015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 277/618] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:58 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:58.536851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:58.539164 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:58.552228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.556755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.557559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.558875 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.618823 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.619302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.619818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'fault' on Instance uuid 87a8e8f6-08f1-4ac5-beae-03501818ff8f {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:53:58.695721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:58.704178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b141c720-7467-40b1-9056-a094da241647 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 200 len: 1331 microversion: 2.1 time: 0.172651 May 27 19:53:58.704810 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 342/619] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:58 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:53:58.931784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:58.933062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:58.942354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.942816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:58.944253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:58.945107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.146583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:59.165966 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:59.168063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:53:59.169944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e83cccf6-eae3-4183-a8b4-287ce1e1f0e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.242840 May 27 19:53:59.171035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 278/620] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:53:58 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:53:59.208977 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3246fab5-38c5-4089-9b52-dc83f4a8752a req-c79d8812-120b-4145-acd2-249146dc2a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:59.219301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3246fab5-38c5-4089-9b52-dc83f4a8752a req-c79d8812-120b-4145-acd2-249146dc2a7b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:59.220156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3246fab5-38c5-4089-9b52-dc83f4a8752a req-c79d8812-120b-4145-acd2-249146dc2a7b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.237078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3246fab5-38c5-4089-9b52-dc83f4a8752a req-c79d8812-120b-4145-acd2-249146dc2a7b service nova] Creating event network-changed:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:53:59.243055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3246fab5-38c5-4089-9b52-dc83f4a8752a req-c79d8812-120b-4145-acd2-249146dc2a7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038833 May 27 19:53:59.243925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 343/621] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:53:59.301725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:59.302566 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] [instance: 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:59.313239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:59.314338 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.315356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:59.315978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.363392 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] HTTP exception thrown: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Request method failure captured: May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 HTTP/1.1 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvnRcXXthPsoV9LB0QMHq0SpVTrXT8MblUGoPw_RY9tG0GdCbEKSLsGBCf7Vg2zb1RvGPXXKPo25L5DRcIyq_6-AYE_U8B5ZWhC2LW8jQWo-wrew0Ji1AZvkQAHhg28894hGSwgC4qNCBp9syC3e0Eh7O5nT2-8gkrrAIRHtNW3PdA May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 729158c0db83438a9b762aae3f0009a2 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesActionsTest-595160046 May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:53:59.365241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/729158c0db83438a9b762aae3f0009a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/729158c0db83438a9b762aae3f0009a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_729158c0db83438a9b762aae3f0009a2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/729158c0db83438a9b762aae3f0009a2"}]}] May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesActionsTest-595160046 May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 729158c0db83438a9b762aae3f0009a2 May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesActionsTest-595160046 May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesActionsTest-595160046-project May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 83d3494760b84bc1aad951bba11caea3 May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesActionsTest-595160046-project May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. May 27 19:53:59.367298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0'} May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:53:59.368253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. May 27 19:53:59.369653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:53:59.379910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] Returning 404 to user: Instance 5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:53:59.379910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-440e778f-b91d-4169-9cb1-364968c497e7 tempest-VolumesActionsTest-595160046 tempest-VolumesActionsTest-595160046-project] 10.222.0.13 "GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0" status: 404 len: 111 microversion: 2.1 time: 0.071929 May 27 19:53:59.379910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 279/622] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:59 2022] GET /compute/v2.1/servers/5e6cdb42-c311-4c2f-96b7-7c3b83e2fdc0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:53:59.725765 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:59.726821 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:53:59.741782 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:59.743992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.745070 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:53:59.746988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:53:59.789119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f HTTP/1.1 May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:53:59.792222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:53:59.793855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '87a8e8f6-08f1-4ac5-beae-03501818ff8f'} May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:53:59.795141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:53:59.796415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:53:59.799599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:53:59.799599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bed87e8e-cfd8-40a1-a350-e605cfdfb427 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 404 len: 111 microversion: 2.1 time: 0.077274 May 27 19:53:59.799599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 344/623] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:53:59 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:53:59.810569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6e88c47b-21a6-478b-aea9-a71d392c702d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '.version_select at 0x7fe1b48eaee0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:53:59.914610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6e88c47b-21a6-478b-aea9-a71d392c702d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352313183" status: 202 len: 0 microversion: 2.1 time: 0.110173 May 27 19:53:59.915361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 280/624] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 19:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352313183 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:53:59.958279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e0c3f470-4799-459d-9c4a-812ec919fac9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: .version_select at 0x7fe1b47a6ca0>, body: {"keypair": {"name": "tempest-keypair-1915482917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpsldGXyTXaioT5CcizQYSTRk4alJ4CD0yV9Syhp8+bblsDzyYz9L3NT9/B///a7lGjA5iG87W58n93migPj33sKKmPp85c2zM5jnFZSWGPUjfzOyb6t/LabjdyyTYSAQ=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:53:59.991675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-e0c3f470-4799-459d-9c4a-812ec919fac9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for project 3388fd386824477385e3ad6baa4cae56. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:00.007898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-e0c3f470-4799-459d-9c4a-812ec919fac9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for user a13d2c50c5204c859872e99bc45c6566 and project 3388fd386824477385e3ad6baa4cae56. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:00.109316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e0c3f470-4799-459d-9c4a-812ec919fac9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155313 May 27 19:54:00.110230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 345/625] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:53:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:00.191213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:00.191986 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:00.196357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:00.200769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:00.201245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:00.202977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:00.202977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:00.590425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:00.606756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:00.616128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:00.616128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4aeb1803-afbc-43f1-b931-ae0dbf58c4f6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.424219 May 27 19:54:00.616128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 281/626] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:00 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:01.446284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:01.446836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:01.449872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:01.454059 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.459721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.459721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.459721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.605416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'services' on Instance uuid 2c6870d2-0e10-4d9d-b00a-35b77afceb0d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:54:01.633836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:01.635157 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:01.642576 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.643354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.644321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.645346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.840566 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:01.851601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:01.853749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:01.854929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0625d409-507e-40e7-a39c-4214c9ed2596 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.226348 May 27 19:54:01.855482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 282/627] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:01 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:01.923613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bf57c318-1651-49be-8386-e3dc692ba2d4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments/d4ed7997-d1ab-4b47-a6d9-21e9cf522267" status: 202 len: 0 microversion: 2.1 time: 0.482648 May 27 19:54:01.924925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 346/628] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:54:01 2022] DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments/d4ed7997-d1ab-4b47-a6d9-21e9cf522267 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:54:01.933276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:01.934231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:01.940339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.940792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.941592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:01.942030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:01.972766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ea6c9dfd-9e83-4ba0-ad1a-203697b98763 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043438 May 27 19:54:01.973346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 283/629] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:54:01 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:02.633362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-555282303"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:02.633981 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:02.640351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:02.640800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:02.641678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:02.642115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:02.645778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:02.840129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.network.security_group_api [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Adding security group 043f6af8-2169-4049-88ef-15e143b2a5b5 to port 303186bb-8e3b-42d5-a8e3-68fba189c88d May 27 19:54:02.872182 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:02.872788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:02.879671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:02.880124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:02.881562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:02.882017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.017454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:03.026524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:03.028046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:03.029342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-30056a35-6aff-4ba4-ad50-84e03b5373cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.160983 May 27 19:54:03.029909 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 284/630] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:02 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:54:03.040810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:03.040810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:03.043729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:03.044196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.045016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:03.045458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.075872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ec1f6c39-edf8-4b5e-9e5f-5ba27714ce74 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 May 27 19:54:03.076466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 285/631] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:54:03 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:03.510894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4b6b4b3f-227b-491e-a491-b641f23d786b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action" status: 202 len: 0 microversion: 2.1 time: 0.883076 May 27 19:54:03.515102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 347/632] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:54:02 2022] POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:54:03.527469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:03.528109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:03.531014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-a468a790-1278-49fc-b62e-69a59334df7b req-bc823223-8eed-4edd-af5e-0ced980cbfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:03.547982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:03.547982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.548217 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a468a790-1278-49fc-b62e-69a59334df7b req-bc823223-8eed-4edd-af5e-0ced980cbfcd service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:03.548217 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a468a790-1278-49fc-b62e-69a59334df7b req-bc823223-8eed-4edd-af5e-0ced980cbfcd service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.548381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:03.548381 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:03.563280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-a468a790-1278-49fc-b62e-69a59334df7b req-bc823223-8eed-4edd-af5e-0ced980cbfcd service nova] Creating event network-changed:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:54:03.569428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-a468a790-1278-49fc-b62e-69a59334df7b req-bc823223-8eed-4edd-af5e-0ced980cbfcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043334 May 27 19:54:03.570496 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 348/633] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:03.578426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1069594542", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e40ccd07-4997-4327-b6e0-646e8d04a640"}], "security_groups": [{"name": "tempest-securitygroup--304238200"}], "key_name": "tempest-keypair-1915482917", "user_data": "}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:03.692629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] validate_networks() for [('e40ccd07-4997-4327-b6e0-646e8d04a640', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:54:03.714471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:03.722893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8286322d-bb8a-4dd5-8a4f-25815e99de5b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1759 microversion: 2.1 time: 0.202855 May 27 19:54:03.723473 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 286/634] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:03 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:04.049716 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:04.055848 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:04.058745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.059412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.060692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.061342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.079375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:54:04.087778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:54:04.088610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:54:04.089122 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:54:04.090328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:54:04.106312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.106915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.111172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.111896 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.157570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:04.168757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Getting quotas for user a13d2c50c5204c859872e99bc45c6566 and project 3388fd386824477385e3ad6baa4cae56. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:04.185952 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:54:04.191624 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:54:04.283346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:04.296100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:04.298962 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:04.300916 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-12906522-007c-4d1b-a9d6-6dfec7be47d4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1808 microversion: 2.20 time: 0.256851 May 27 19:54:04.302212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 287/635] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:04 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:54:04.310959 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:04.312916 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:04.323777 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.324981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.326447 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:04.332406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:04.347384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9f3b00fa-2ee7-4ab8-8a12-628460a01316 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.774420 May 27 19:54:04.349753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 349/636] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:54:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:54:04.360811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4c211551-2485-4659-9c79-98112bd91e81 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:04.361939 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4c211551-2485-4659-9c79-98112bd91e81 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:04.374530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-65084d80-35b7-4fbd-9e0e-2ab165db58d9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070170 May 27 19:54:04.375742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 288/637] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:54:04 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:04.429582 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4c211551-2485-4659-9c79-98112bd91e81 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:04.436458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4c211551-2485-4659-9c79-98112bd91e81 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1246 microversion: 2.1 time: 0.080557 May 27 19:54:04.437300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 350/638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:04 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:05.321835 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:05.322573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:05.330593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.331036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.331802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.332238 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.389451 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:05.392419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:05.427224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.427823 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.428796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.429260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.483201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c11e647f-a828-40aa-8042-45bd54db101e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100214 May 27 19:54:05.484140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 351/639] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:54:05 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 19:54:05.489083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:05.490290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:05.496790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.497387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.499257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.500771 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.510107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:05.522675 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:05.525153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:05.527192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-04818485-4b8c-471e-96f7-2939f8f4b7d7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1795 microversion: 2.20 time: 0.209927 May 27 19:54:05.529422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 289/640] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:05 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1795 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:05.576944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:05.577713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:05.585756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.586440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.587402 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.588001 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.607190 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:05.622888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:54:05.623454 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1a1d639b-e6be-4a65-8e44-099901513e77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1250 microversion: 2.1 time: 0.137429 May 27 19:54:05.635569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 352/641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:05 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1250 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:05.901439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1a2f054c-2665-47ac-a167-f010f2520cc3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 204 len: 0 microversion: 2.1 time: 0.328563 May 27 19:54:05.902864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 290/642] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:54:05 2022] DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 19:54:05.911181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:05.912718 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:05.919324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.920081 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:05.921258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:05.921885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:06.132517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:06.141384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-96e5adf9-9537-4144-b230-60f92412c607 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1682 microversion: 2.1 time: 0.234074 May 27 19:54:06.152938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 353/643] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:05 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:06.644180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:06.645143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:06.655333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:06.657671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:06.658616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:06.662540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:06.799901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:06.811104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ddbe75d2-7992-4bd0-98f3-dc3625618889 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1298 microversion: 2.1 time: 0.173052 May 27 19:54:06.818240 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 291/644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:06 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:07.012944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:07.014245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:07.022546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.023374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.024650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.025341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.161416 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:07.163414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:07.171958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.172903 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.174406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.175184 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.272028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b35f5541-8506-4f98-9c2c-20992dfce477 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action" status: 202 len: 0 microversion: 2.1 time: 0.262690 May 27 19:54:07.277567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 354/645] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:54:07 2022] POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:54:07.285099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:07.288111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:07.297768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.298837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.300712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.301408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.345266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:07.367860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bd1acc80-8268-4bc9-8ddb-cad0deef9eec tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1682 microversion: 2.1 time: 0.211755 May 27 19:54:07.371075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 292/646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:07 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:07.555240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:07.563626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3f275001-4673-44c8-88e4-bc4410f9d8f3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1751 microversion: 2.1 time: 0.284215 May 27 19:54:07.564424 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 355/647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:07 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1751 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:07.829346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:07.829956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:07.841872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.844749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.847554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:07.848021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:07.906753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:08.002499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:08.018375 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5c6726ab-2ae9-4077-8176-3b015d81803e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1298 microversion: 2.1 time: 0.193303 May 27 19:54:08.019253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 293/648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:07 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:08.388137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:08.388856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:08.413602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:08.414811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:08.415690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:08.417570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:08.581556 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:08.582554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:08.590446 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:08.591723 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:08.592796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:08.593480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:08.718255 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:08.728072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5f195955-e98c-46d4-a230-95a3672c6653 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1682 microversion: 2.1 time: 0.343431 May 27 19:54:08.728713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 356/649] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:08 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1682 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:09.041568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:09.042399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:09.043968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:09.058245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:09.058805 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:09.059597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:09.060037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:09.078745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e9b6c475-2f62-4d30-8cf2-10599e0f2429 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1751 microversion: 2.1 time: 0.500926 May 27 19:54:09.079561 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 294/650] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:08 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1751 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:09.201566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:09.214462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-888eb66f-ab11-49f0-8e37-fb2bab921df4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1304 microversion: 2.1 time: 0.181920 May 27 19:54:09.218002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 357/651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:09 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:09.755319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:09.757009 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:09.787764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:09.793059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:09.794395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:09.795426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:09.917898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:09.940346 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-203cd2ee-6333-4d56-97cf-f90e03696d0f tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1615 microversion: 2.1 time: 0.194983 May 27 19:54:09.954165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 295/652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:09 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1615 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:10.096448 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:10.097753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:10.111970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.118731 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.119815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.129565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-5efe2d21-f1c5-4f65-822e-162c879035a8 req-c1e20d3b-cc7c-4b64-be88-1245abd5ad3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6870d2-0e10-4d9d-b00a-35b77afceb0d", "name": "network-vif-deleted", "tag": "b0920c8f-86db-4b0c-8e65-a7d5286779ee"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:10.141334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.155573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-5efe2d21-f1c5-4f65-822e-162c879035a8 req-c1e20d3b-cc7c-4b64-be88-1245abd5ad3b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.156444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-5efe2d21-f1c5-4f65-822e-162c879035a8 req-c1e20d3b-cc7c-4b64-be88-1245abd5ad3b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.206770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-5efe2d21-f1c5-4f65-822e-162c879035a8 req-c1e20d3b-cc7c-4b64-be88-1245abd5ad3b service nova] Creating event network-vif-deleted:b0920c8f-86db-4b0c-8e65-a7d5286779ee for instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d on hv-cinder-83979 May 27 19:54:10.222186 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-5efe2d21-f1c5-4f65-822e-162c879035a8 req-c1e20d3b-cc7c-4b64-be88-1245abd5ad3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096093 May 27 19:54:10.228594 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 296/653] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:54:10.247364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:10.249995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:10.268020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.269341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.272489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.273556 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.469087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:10.486419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f2e1fd67-ca22-4e47-835c-11f8e0a3141a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.254265 May 27 19:54:10.487415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 297/654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:10 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:10.586626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:10.598790 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c9b5aff0-6f3f-48db-b4c8-83d74113113d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.506209 May 27 19:54:10.602517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 358/655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:10 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:10.963531 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:10.964698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:10.979523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.981543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:10.984335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:10.985321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.053267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.053967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.054601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'fault' on Instance uuid 2c6870d2-0e10-4d9d-b00a-35b77afceb0d {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:54:11.138059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:11.154541 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-eee77d3d-4c93-4313-a00e-0218d7af30e8 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 200 len: 1331 microversion: 2.1 time: 0.197211 May 27 19:54:11.156703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 298/656] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:10 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 1331 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:11.446806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-803d3825-aca3-4474-9b21-bb1460cb4f4a req-a4a82c57-d744-4c62-bd11-0d1fc46767d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:11.459907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-803d3825-aca3-4474-9b21-bb1460cb4f4a req-a4a82c57-d744-4c62-bd11-0d1fc46767d3 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.460355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-803d3825-aca3-4474-9b21-bb1460cb4f4a req-a4a82c57-d744-4c62-bd11-0d1fc46767d3 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.478125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-803d3825-aca3-4474-9b21-bb1460cb4f4a req-a4a82c57-d744-4c62-bd11-0d1fc46767d3 service nova] Creating event network-changed:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:54:11.498245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-803d3825-aca3-4474-9b21-bb1460cb4f4a req-a4a82c57-d744-4c62-bd11-0d1fc46767d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059206 May 27 19:54:11.500545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 359/657] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:54:11.504709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:11.514588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:11.534803 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.535266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.538015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.538474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.620656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:11.621394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:11.629914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.632942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.633134 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:11.633535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:11.738880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:11.749591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-851c0a85-f860-459b-bdde-5713056da391 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.249525 May 27 19:54:11.750203 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 299/658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:11 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:12.122123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:12.130860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-eee35e16-eab3-41db-8aec-e16ed0fe5dd3 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.514267 May 27 19:54:12.131704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 360/659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:11 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:12.173774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:12.174474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:12.181817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:12.182558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:12.183712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:12.184071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:12.200793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d HTTP/1.1 May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:54:12.202849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:54:12.204269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '2c6870d2-0e10-4d9d-b00a-35b77afceb0d'} May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:54:12.205094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:54:12.206954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:54:12.208898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:54:12.208898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ad96af52-1e10-4f36-b683-c3bbae054e42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 404 len: 111 microversion: 2.1 time: 0.034794 May 27 19:54:12.208898 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 300/660] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:12 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:54:12.214287 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-663a3a27-25a1-4078-84ba-1619e8241533 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '.version_select at 0x7fe1b47a65e0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:12.296772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-663a3a27-25a1-4078-84ba-1619e8241533 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791077963" status: 202 len: 0 microversion: 2.1 time: 0.085827 May 27 19:54:12.297511 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 361/661] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 19:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791077963 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:54:12.769249 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:12.769885 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:12.777354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:12.777803 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:12.778613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:12.779051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:13.007496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:13.018399 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8d2e5629-f6d0-4e49-af72-6a3cbe0fa8d7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.254328 May 27 19:54:13.018980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 301/662] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:12 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:13.147431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:13.148002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:13.155228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:13.161180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:13.161180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:13.161180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:13.329195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:13.339752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-89112335-feb7-4941-8dfe-a20ba4a7c4bb tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.196248 May 27 19:54:13.340818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 362/663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:13 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:13.382540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c5969fde-c41f-4a56-b9c2-65357c858cde tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: .version_select at 0x7fe1b48b0b80>, body: {"keypair": {"name": "tempest-keypair-1990486228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSYWFblxg7cMJu7DxZ5Oe9qfquFCWq0pEfzVRAJmO5L3bsdh+dgfP+lMkL+poSsqacfBn4DIblkQXwss8zxafs3Sj9XO2n/i6F+pjeZveZF3jZ1YLiL9Q9hYLDzsGzp7g=="}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:13.398406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-c5969fde-c41f-4a56-b9c2-65357c858cde tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:13.404193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-c5969fde-c41f-4a56-b9c2-65357c858cde tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:13.490817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c5969fde-c41f-4a56-b9c2-65357c858cde tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113769 May 27 19:54:13.492052 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 302/664] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:54:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:14.036945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:14.038089 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:14.044447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:14.044902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:14.048374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:14.048374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:14.120900 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:14.328254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:14.340538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-36568e97-bb97-4540-bb51-1bb58be7947e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.308509 May 27 19:54:14.351365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 363/665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:14 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:14.363466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:14.364335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:14.371329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:14.371780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:14.372728 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:14.373374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:14.607404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:14.617997 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9862ed94-594b-434e-b722-b870432a23f1 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.263073 May 27 19:54:14.629673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 303/666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:14 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:15.360176 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:15.361561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:15.366571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=12 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:15.372426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:15.373120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:15.374113 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:15.374743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:15.631980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:15.639400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:15.640607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:15.642402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-eb6976fa-afd5-41ae-9200-8c43e07667ec tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.287624 May 27 19:54:15.643380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 364/667] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:15 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:15.663703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:15.664398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:15.665608 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:15.666255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:15.860694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:15.871757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-44e67e28-1f54-4cea-8ec6-9b5a43aba3fd tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.237062 May 27 19:54:15.874007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 304/668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:15 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:16.652740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1045424540", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc686edf-9590-4ae1-ab4c-4d4524b126ab"}], "security_groups": [{"name": "tempest-securitygroup--1599737236"}], "key_name": "tempest-keypair-1990486228", "user_data": "}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:16.660331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:16.660937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:16.675549 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:16.675944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:16.676772 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:16.677762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:16.809910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] validate_networks() for [('dc686edf-9590-4ae1-ab4c-4d4524b126ab', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:54:16.843408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:16.852852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c09320cd-691c-42c7-a0e1-5cc5e95463ce tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.196214 May 27 19:54:16.863339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 305/669] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:16 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:16.895107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:16.896778 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:16.907863 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:16.908452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:16.909542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:16.910427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:17.108128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:17.121841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-25111331-0e31-413b-9d6d-ead179b3edce tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.232243 May 27 19:54:17.134586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 306/670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:16 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:17.351039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:54:17.351657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:54:17.352134 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:54:17.352540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:54:17.352946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:54:17.363101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:17.363543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:17.364913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:17.365622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:17.384671 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:17.389272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:17.403191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:54:17.405584 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:54:17.566682 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9c1fd77d-6b6d-44c6-b81b-991997e4526b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.918190 May 27 19:54:17.573724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 365/671] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:54:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:54:17.578245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2b8c5bc5-9b5a-460d-bc04-75521c099a43 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:17.578852 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2b8c5bc5-9b5a-460d-bc04-75521c099a43 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:17.643410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2b8c5bc5-9b5a-460d-bc04-75521c099a43 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:17.653415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2b8c5bc5-9b5a-460d-bc04-75521c099a43 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1242 microversion: 2.1 time: 0.078932 May 27 19:54:17.655822 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 307/672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:17 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:17.870586 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:17.873028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:17.880584 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:17.881064 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:17.881838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:17.882273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:18.096760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:18.107192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-40bab625-affe-4091-b9b0-13ee3674c319 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.241121 May 27 19:54:18.108794 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 366/673] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:17 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:18.143418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:18.144013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:18.151699 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:18.152168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:18.152907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:18.153532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:18.370543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:18.384377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9c333688-8f8e-4b5e-af18-9a52628a7fe2 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.244726 May 27 19:54:18.385507 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 308/674] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:18 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:18.674165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:18.674786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:18.682416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:18.683374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:18.684381 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:18.685135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:18.777293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:18.781271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:18.806079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ac6c57e4-1ba4-409f-a413-ae28e2676851 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1246 microversion: 2.1 time: 0.123110 May 27 19:54:18.806079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 367/675] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:18 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:19.126550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:19.127562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:19.141510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.146020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.150030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.153053 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.402875 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:19.408262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:19.412545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:19.429647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.430876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.430876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.431295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.433504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f661273d-b3c8-4891-990c-13dba0c63b47 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.312146 May 27 19:54:19.440069 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 309/676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:19 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:19.452905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-abbd23d6-2466-4b95-bb46-990fcb86315f req-233c735d-8608-4be8-bbb3-a74640304140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "name": "network-vif-plugged", "status": "completed", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:19.472998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-abbd23d6-2466-4b95-bb46-990fcb86315f req-233c735d-8608-4be8-bbb3-a74640304140 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.517683 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-abbd23d6-2466-4b95-bb46-990fcb86315f req-233c735d-8608-4be8-bbb3-a74640304140 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.575590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-abbd23d6-2466-4b95-bb46-990fcb86315f req-233c735d-8608-4be8-bbb3-a74640304140 service nova] Creating event network-vif-plugged:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:54:19.588406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-abbd23d6-2466-4b95-bb46-990fcb86315f req-233c735d-8608-4be8-bbb3-a74640304140 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147053 May 27 19:54:19.589617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 310/677] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:19.759024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:19.769546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e882678b-49fb-4500-a736-771097d44a95 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.370079 May 27 19:54:19.772251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 368/678] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:19 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:19.816887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:19.819171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:19.833920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.833920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.833920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:19.833920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:19.963871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:19.976423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b044a60e-88c7-49a7-9784-3db64a8bdac6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1302 microversion: 2.1 time: 0.163986 May 27 19:54:19.978402 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 311/679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:19 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1302 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:20.458625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:20.460191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:20.469578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:20.473749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:20.476609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:20.477350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:20.789502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:20.790581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:20.805018 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:20.817237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:20.818874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:20.819550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:20.872310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:20.884383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f5b26c38-310a-4f37-9488-90898ec51e62 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.430025 May 27 19:54:20.885732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 369/680] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:20 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:21.008098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:21.009018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:21.025469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:21.026368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:21.027698 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:21.028453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:21.174360 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:21.186917 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-aed531e0-10ba-40bf-a029-344e0a53aece tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.403251 May 27 19:54:21.200183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 312/681] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:20 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:21.280348 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:21.300330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-810c7e5e-082a-4524-b085-abfef85e4000 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.301141 May 27 19:54:21.306328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 370/682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:20 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:21.907093 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:21.907680 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:21.931032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:21.931827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:21.935204 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:21.937635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.206090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:22.207352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:22.216431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:22.224901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.225780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:22.226228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.290933 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:22.295735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:22.310494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-640691a7-c505-435e-b984-4994dbdbb98e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1371 microversion: 2.1 time: 0.408469 May 27 19:54:22.316071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 313/683] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:21 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:22.326677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:22.329060 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:22.343556 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:22.345565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.346836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:22.348982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.534757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:22.544216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6371bc79-38d6-4a0e-a11b-7297da2967fa tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.224053 May 27 19:54:22.545960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 314/684] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:22 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:22.561071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:22.571925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-76f4ce28-dbe3-46b3-a3c3-33d30c7b6f88 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.369740 May 27 19:54:22.573542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 371/685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:22 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:22.876536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-309ac1e3-71fc-48e9-a5a6-15577080a6e7 req-e5dfdf97-d1cc-4cf4-a05e-066d85320616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103930b7-69c6-42cc-89de-8f69b48c79d8", "tag": "ea65af22-78c0-4852-9eaa-a6db38529d3a"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:22.912862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-309ac1e3-71fc-48e9-a5a6-15577080a6e7 req-e5dfdf97-d1cc-4cf4-a05e-066d85320616 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:22.915345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-309ac1e3-71fc-48e9-a5a6-15577080a6e7 req-e5dfdf97-d1cc-4cf4-a05e-066d85320616 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:22.974532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-309ac1e3-71fc-48e9-a5a6-15577080a6e7 req-e5dfdf97-d1cc-4cf4-a05e-066d85320616 service nova] Creating event network-changed:ea65af22-78c0-4852-9eaa-a6db38529d3a for instance 103930b7-69c6-42cc-89de-8f69b48c79d8 on hv-cinder-83979 May 27 19:54:22.995981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-309ac1e3-71fc-48e9-a5a6-15577080a6e7 req-e5dfdf97-d1cc-4cf4-a05e-066d85320616 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125299 May 27 19:54:23.001615 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 315/686] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:23.337068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:23.337723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:23.355185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.355634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:23.359855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.367764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:23.566503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:23.567822 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:23.586976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.587611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:23.589140 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.591803 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:23.781400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:23.794911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fb073bea-f844-4f90-b437-c9070a29b3f6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1564 microversion: 2.1 time: 0.465407 May 27 19:54:23.808151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 372/687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:23 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1564 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:23.818456 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:23.821035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:23.840445 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.841422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:23.842438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:23.843042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:24.013769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:24.040645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d21357a2-4847-4b54-9bcd-94a5a337829a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.478703 May 27 19:54:24.061876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 316/688] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:23 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:24.077616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:24.082201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:24.091272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:24.092926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:24.094218 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:24.094867 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:24.154037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:24.186260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a2679849-6547-4a73-a54c-0508e1690dc7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.376479 May 27 19:54:24.197507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 373/689] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:23 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:24.327103 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-be616a59-438d-49cf-a962-c67dd37d6750 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259368 May 27 19:54:24.328105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 317/690] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:54:24 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:25.073898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:25.074578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:25.095240 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:25.095991 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:25.096821 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:25.103474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:25.209237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:25.210688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:25.223795 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:25.224362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:25.226624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:25.227075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:25.602833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:25.614956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2e247820-cc3b-4726-b2b9-0663676719cc tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1756 microversion: 2.1 time: 0.410560 May 27 19:54:25.615539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 318/691] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:25 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1756 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:25.640251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:25.656930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-34bef683-3f7e-4030-a611-737befde2f1b tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.591525 May 27 19:54:25.659601 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 374/692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:25 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:25.954050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-965e93e6-62a1-43a8-9cfd-9d7dabb6119a req-99bd07b9-4774-40f1-9f29-4256277c8491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:25.965895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-965e93e6-62a1-43a8-9cfd-9d7dabb6119a req-99bd07b9-4774-40f1-9f29-4256277c8491 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:25.966632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-965e93e6-62a1-43a8-9cfd-9d7dabb6119a req-99bd07b9-4774-40f1-9f29-4256277c8491 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:25.980012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-965e93e6-62a1-43a8-9cfd-9d7dabb6119a req-99bd07b9-4774-40f1-9f29-4256277c8491 service nova] Creating event network-changed:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:54:26.015277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-965e93e6-62a1-43a8-9cfd-9d7dabb6119a req-99bd07b9-4774-40f1-9f29-4256277c8491 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064843 May 27 19:54:26.023051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 319/693] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:26.632910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:26.633590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:26.647423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:26.651105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:26.652317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:26.654475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:26.675836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:26.677616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:26.694354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:26.694806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:26.695586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:26.696271 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:26.871815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:26.882403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5197c718-6e3a-4695-9e3b-c097c4999c3b tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1759 microversion: 2.1 time: 0.254542 May 27 19:54:26.895010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 375/694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:26 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1759 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:27.195434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:27.205952 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6a020e79-4cd4-45f7-81e9-3bae1039763e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.534541 May 27 19:54:27.217029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 320/695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:26 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:54:28.125666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1b125179-088a-46a0-9a0f-afb14f61c4fb req-8d0508a0-d231-4cd2-865f-caf28288d30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103930b7-69c6-42cc-89de-8f69b48c79d8", "name": "network-vif-plugged", "status": "completed", "tag": "ea65af22-78c0-4852-9eaa-a6db38529d3a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:28.132274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:28.136343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:28.138423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1b125179-088a-46a0-9a0f-afb14f61c4fb req-8d0508a0-d231-4cd2-865f-caf28288d30e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:28.139062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1b125179-088a-46a0-9a0f-afb14f61c4fb req-8d0508a0-d231-4cd2-865f-caf28288d30e service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:28.159667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1b125179-088a-46a0-9a0f-afb14f61c4fb req-8d0508a0-d231-4cd2-865f-caf28288d30e service nova] Creating event network-vif-plugged:ea65af22-78c0-4852-9eaa-a6db38529d3a for instance 103930b7-69c6-42cc-89de-8f69b48c79d8 on hv-cinder-83979 May 27 19:54:28.167550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1b125179-088a-46a0-9a0f-afb14f61c4fb req-8d0508a0-d231-4cd2-865f-caf28288d30e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045786 May 27 19:54:28.169427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 376/696] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:28.224278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:28.225554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:28.227775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:28.230404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:28.233926 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:28.234492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:28.236563 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:28.237227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:28.553383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:28.564907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-25a32723-47d9-4d64-a73d-2a159a42d696 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.344798 May 27 19:54:28.567645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 321/697] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:28 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:29.584203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:29.584996 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:29.595198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:29.595198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:29.595198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:29.595198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:29.734203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:29.745740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bf941f8b-e9f8-41de-9ad5-fbca8bbb311d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1368 microversion: 2.1 time: 0.166594 May 27 19:54:29.746592 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 377/698] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:29 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:30.766191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:30.771141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:30.782874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:30.786762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:30.787658 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:30.788332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:31.116691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:31.124835 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c9e5404d-e3d8-4edf-acc0-c55bf96d348e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1559 microversion: 2.1 time: 0.364131 May 27 19:54:31.125558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 322/699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:30 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1559 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:31.142125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:31.144310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:31.148645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:31.150766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:31.151215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:31.152193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:31.152627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:31.256669 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-360fa0ec-eb7d-42ad-a373-c8992d6f34ca tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118157 May 27 19:54:31.257258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 378/700] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:54:31 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:32.850802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-4244c533-ce88-4185-9a9f-f6f988020cce req-62e6b766-e424-493f-bf73-67c1b7d5cb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "103930b7-69c6-42cc-89de-8f69b48c79d8", "tag": "ea65af22-78c0-4852-9eaa-a6db38529d3a"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:32.861672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4244c533-ce88-4185-9a9f-f6f988020cce req-62e6b766-e424-493f-bf73-67c1b7d5cb66 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:32.862363 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4244c533-ce88-4185-9a9f-f6f988020cce req-62e6b766-e424-493f-bf73-67c1b7d5cb66 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:32.875348 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-4244c533-ce88-4185-9a9f-f6f988020cce req-62e6b766-e424-493f-bf73-67c1b7d5cb66 service nova] Creating event network-changed:ea65af22-78c0-4852-9eaa-a6db38529d3a for instance 103930b7-69c6-42cc-89de-8f69b48c79d8 on hv-cinder-83979 May 27 19:54:32.881240 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-4244c533-ce88-4185-9a9f-f6f988020cce req-62e6b766-e424-493f-bf73-67c1b7d5cb66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034801 May 27 19:54:32.882412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 323/701] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:54:36.980491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-03d96264-5704-45ff-9a4b-3e59e68c08a3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Action: 'create', calling method: .version_select at 0x7fe1b48260d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-540601896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZrPQ3RXsXX63OVCPuR0VOEMEcv0266xP7F4U53t+BzQTlnOtLOI5GGGhkU//EDG1xMM5hp7DIz0Kj66V4rM7WLai+tYv4R9RLJko7RCMJWW48KGRnkyGoOb0jUIqBOOg=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:36.994725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-03d96264-5704-45ff-9a4b-3e59e68c08a3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Getting quotas for project 28f2a07b1f3646209dfdc37dcd2b755e. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:36.998464 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-03d96264-5704-45ff-9a4b-3e59e68c08a3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Getting quotas for user 67ef94416f1741a88c1e18106cad8b2c and project 28f2a07b1f3646209dfdc37dcd2b755e. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:37.078499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-03d96264-5704-45ff-9a4b-3e59e68c08a3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.272414 May 27 19:54:37.079096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 379/702] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:54:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:47.675228 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:47.675846 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=46 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:47.680069 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:47.680690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:47.687213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:47.687794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:47.688542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:47.688988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:47.720998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-369bbee4-519b-4374-9a11-9c002cacd71f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments/645ae4a2-3dbd-4f96-b8ea-d9b741c5032b" status: 200 len: 194 microversion: 2.20 time: 0.047426 May 27 19:54:47.721818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 324/703] 10.222.0.13 () {60 vars in 1453 bytes} [Fri May 27 19:54:47 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments/645ae4a2-3dbd-4f96-b8ea-d9b741c5032b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:54:47.786042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=60 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:47.786836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:47.787457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:47.791491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:47.797518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:47.798034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:47.798485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:47.799243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:47.799678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:47.883897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lazy-loading 'services' on Instance uuid 59595754-b21e-43c4-a3bd-2d0cd810a8d7 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:54:48.122587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fbeee9c6-655e-486e-a52e-fea65fc34b30 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments/645ae4a2-3dbd-4f96-b8ea-d9b741c5032b" status: 202 len: 0 microversion: 2.20 time: 0.337602 May 27 19:54:48.123174 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 380/704] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 27 19:54:47 2022] DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments/645ae4a2-3dbd-4f96-b8ea-d9b741c5032b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 19:54:48.132398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:48.133373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:48.140308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:48.141007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:48.141984 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:48.142575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:48.173440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-66dfb738-70bb-4856-8125-60de5a42adc6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 May 27 19:54:48.173977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 325/705] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 19:54:48 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:54:49.186234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:49.187893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:49.194944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:49.195395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:49.196156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:49.196620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:49.227036 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6d9d23b2-9fe0-4617-8c62-25781b27d167 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045283 May 27 19:54:49.227625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 381/706] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 19:54:49 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:54:50.243124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:50.243942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:50.250678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.251122 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.251878 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.252307 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.282183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a6c1a204-4983-4850-a59a-556a1d9a77ee tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043562 May 27 19:54:50.282742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 326/707] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 19:54:50 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:50.342121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:50.342631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:50.350328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.350781 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.351561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.352000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.377375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:54:50.670485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bf52aed0-4216-4246-a630-c1a34670d9ef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 204 len: 0 microversion: 2.20 time: 0.332150 May 27 19:54:50.671070 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 382/708] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 19:54:50 2022] DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 19:54:50.679329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:50.679933 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:50.685964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.686410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.688146 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:50.688590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:50.824666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:50.833598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:50.835127 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:50.839496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-507bf43e-f625-4672-82bf-4469752986d3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.160881 May 27 19:54:50.839496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 327/709] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:50 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:51.856371 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:51.857182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:51.864092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:51.864539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:51.865344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:51.865778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:51.996878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:52.005641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:52.007136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:52.008290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-86e923d9-fc46-49ee-b311-86ff97924b8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.156545 May 27 19:54:52.008838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 383/710] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:51 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:53.026754 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:53.028121 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:53.036448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:53.038487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:53.038487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:53.038487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:53.247741 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:53.255992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:53.257635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:53.258790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-961ca6a9-03a9-4686-b48f-e493c75c98a9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1723 microversion: 2.20 time: 0.236048 May 27 19:54:53.259354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 328/711] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:53 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:53.663041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-5fdeed76-0228-4ce3-8814-f0989dc64d97 req-c52f6714-6d90-4f0f-a9cc-20f88a0a6b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59595754-b21e-43c4-a3bd-2d0cd810a8d7", "name": "network-vif-deleted", "tag": "fb2014bd-803c-4d77-9271-a2e529c03ef8"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:53.673078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-5fdeed76-0228-4ce3-8814-f0989dc64d97 req-c52f6714-6d90-4f0f-a9cc-20f88a0a6b16 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:53.673656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-5fdeed76-0228-4ce3-8814-f0989dc64d97 req-c52f6714-6d90-4f0f-a9cc-20f88a0a6b16 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:53.688797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-5fdeed76-0228-4ce3-8814-f0989dc64d97 req-c52f6714-6d90-4f0f-a9cc-20f88a0a6b16 service nova] Creating event network-vif-deleted:fb2014bd-803c-4d77-9271-a2e529c03ef8 for instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 on hv-cinder-83979 May 27 19:54:53.693865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-5fdeed76-0228-4ce3-8814-f0989dc64d97 req-c52f6714-6d90-4f0f-a9cc-20f88a0a6b16 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035167 May 27 19:54:53.694530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 384/712] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:54:54.277788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:54.278387 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:54.285599 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:54.286043 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:54.286838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:54.287268 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:54.319848 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:54.320291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:54.320736 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lazy-loading 'fault' on Instance uuid 59595754-b21e-43c4-a3bd-2d0cd810a8d7 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:54:54.363327 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:54.371386 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:54.372863 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:54.374032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5fc02dfa-1934-48ff-b4d5-bd159d0f69e8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 200 len: 1372 microversion: 2.20 time: 0.100106 May 27 19:54:54.375326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 329/713] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:54 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:54:55.393382 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:55.394071 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:55.400629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:55.401101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:55.401848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:55.402274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:55.573975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 HTTP/1.1 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:54:55.575674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:54:55.577428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '59595754-b21e-43c4-a3bd-2d0cd810a8d7'} May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:54:55.578927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:54:55.580418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:54:55.581876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:54:55.581876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e4726deb-cbc2-4fce-b601-7e2ae7b46f01 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 404 len: 111 microversion: 2.20 time: 0.188024 May 27 19:54:55.581876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 385/714] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:55 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:54:55.586550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b9d9ca6f-3913-4dbf-bac2-220766413b1f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '.version_select at 0x7fe1b4900700>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:55.653722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b9d9ca6f-3913-4dbf-bac2-220766413b1f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872259326" status: 204 len: 0 microversion: 2.20 time: 0.070955 May 27 19:54:55.654220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 330/715] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 19:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872259326 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 19:54:56.421666 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-20279a7a-3101-4834-a4c5-fb50c1d2265f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: .version_select at 0x7fe1b46d8670>, body: {"keypair": {"name": "tempest-keypair-1142370934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHewJDIJqSCgUQQhFbngox5AI5JMrDQYwbLO+zP65c6G9PR+3meWw/3iGuzaNkzj4IMRQjFAsXQT3wIHyxS0M07sXR+oQMvRGepGOTulHuTH3y5PWVJJqgMAoiNqKEn7w=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:56.436283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-20279a7a-3101-4834-a4c5-fb50c1d2265f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for project 2efe5f8c717640528624dc103744dcf4. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:56.440100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-20279a7a-3101-4834-a4c5-fb50c1d2265f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for user ed8754ddcfd54c24ac923db0fedc1606 and project 2efe5f8c717640528624dc103744dcf4. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:56.556851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-20279a7a-3101-4834-a4c5-fb50c1d2265f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.138968 May 27 19:54:56.557458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 386/716] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 19:54:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 19:54:57.910194 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-74818361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-540601896", "security_groups": [{"name": "tempest-secgroup-smoke-834485003"}], "networks": [{"uuid": "fba51d7e-8a37-4ebd-868c-c73556eb8ad7"}], "block_device_mapping_v2": [{"uuid": "b01d3701-ab03-466d-a24c-64e070f8e83a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:58.058675 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] validate_networks() for [('fba51d7e-8a37-4ebd-868c-c73556eb8ad7', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:54:58.635806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:54:58.636270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:54:58.636745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:54:58.637183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:54:58.637595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:54:58.647687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:58.649711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:58.649711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:58.649711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:58.667401 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Getting quotas for project 28f2a07b1f3646209dfdc37dcd2b755e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:58.678429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Getting quotas for user 67ef94416f1741a88c1e18106cad8b2c and project 28f2a07b1f3646209dfdc37dcd2b755e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:58.729368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:54:58.731565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b01d3701-ab03-466d-a24c-64e070f8e83a',volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:54:59.163975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1288e8b5-27cb-43f5-888d-aea6efa3ca0d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.270603 May 27 19:54:59.165036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 331/717] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:54:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 19:54:59.175786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3ec1367b-c5a7-480c-83dd-6fb1d5335916 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:59.177304 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3ec1367b-c5a7-480c-83dd-6fb1d5335916 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:54:59.243429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3ec1367b-c5a7-480c-83dd-6fb1d5335916 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:54:59.250879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3ec1367b-c5a7-480c-83dd-6fb1d5335916 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1086 microversion: 2.1 time: 0.080128 May 27 19:54:59.259849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 387/718] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:54:59 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1086 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:54:59.305372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-829265149", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02c48a8e-6dcb-40bc-b8d2-b504da81ca3c"}], "security_groups": [{"name": "tempest-securitygroup--681960804"}], "key_name": "tempest-keypair-1142370934", "user_data": "}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:54:59.408062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] validate_networks() for [('02c48a8e-6dcb-40bc-b8d2-b504da81ca3c', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:54:59.782753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:54:59.783182 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:54:59.783657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:54:59.784068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:54:59.784492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:54:59.795491 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:59.795937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:59.796741 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:54:59.797528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:54:59.814756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for project 2efe5f8c717640528624dc103744dcf4. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:54:59.818600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Getting quotas for user ed8754ddcfd54c24ac923db0fedc1606 and project 2efe5f8c717640528624dc103744dcf4. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:54:59.830600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:54:59.832705 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:54:59.933826 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-012cb9ab-b31c-41fd-950f-0da18ffc6750 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.632782 May 27 19:54:59.934467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 332/719] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 19:54:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 27 19:54:59.945423 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:54:59.946251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:00.001958 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:00.013778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:00.013778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:00.014571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cad30306-82c7-4771-a452-6abdb44c98ea tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1281 microversion: 2.20 time: 0.072930 May 27 19:55:00.015110 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 388/720] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:54:59 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:00.267826 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:00.268455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:00.275017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:00.275533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:00.276367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:00.276871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:00.338660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:00.346735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1d424b83-4258-4832-84ff-fd29c39d2008 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1136 microversion: 2.1 time: 0.083068 May 27 19:55:00.347308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 333/721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:00 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:01.033447 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:01.034055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:01.040546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:01.041026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:01.041786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:01.042218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:01.102736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:01.110897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:01.112397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:01.113531 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a23e9a06-f049-4962-9ffe-d9ee772a4c5d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1285 microversion: 2.20 time: 0.084770 May 27 19:55:01.116068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 389/722] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:01 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:01.366982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:01.368494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:01.379809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:01.380537 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:01.381480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:01.382165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:01.474144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:01.483559 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f2d5fc9a-ecb2-4331-9193-572c75e9f208 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1202 microversion: 2.1 time: 0.122299 May 27 19:55:01.485017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 334/723] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:01 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1202 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:02.131703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:02.132181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:02.139407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:02.143324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:02.143324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:02.143324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:02.274827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:02.284044 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:02.285587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:02.286910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-aaf5be9b-4f83-4240-a0fd-cbb69a6ebd83 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1351 microversion: 2.20 time: 0.159552 May 27 19:55:02.288007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 390/724] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:02 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:02.502856 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:02.504319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:02.510677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:02.511408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:02.518039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:02.520457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:02.707851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:02.715597 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-45193e25-4865-409c-b6ec-e93e544b3930 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1269 microversion: 2.1 time: 0.216699 May 27 19:55:02.716162 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 335/725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:02 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:03.123150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-34e780e3-5c70-44d2-8938-874ee713ab62 req-8112f5b3-6136-438a-8e82-1b6411f192b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:03.140100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-34e780e3-5c70-44d2-8938-874ee713ab62 req-8112f5b3-6136-438a-8e82-1b6411f192b9 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:03.140888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-34e780e3-5c70-44d2-8938-874ee713ab62 req-8112f5b3-6136-438a-8e82-1b6411f192b9 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:03.160068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-34e780e3-5c70-44d2-8938-874ee713ab62 req-8112f5b3-6136-438a-8e82-1b6411f192b9 service nova] Creating event network-changed:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:55:03.165726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-34e780e3-5c70-44d2-8938-874ee713ab62 req-8112f5b3-6136-438a-8e82-1b6411f192b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048211 May 27 19:55:03.172563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 391/726] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:03.310354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:03.311373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:03.318703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:03.319454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:03.324413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:03.329159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:03.570484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:03.579841 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:03.582366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:03.582484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a96bf9d1-53b6-4db5-b043-43add70d08a6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.276356 May 27 19:55:03.587739 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 336/727] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:03 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:03.733682 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:03.734870 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:03.741953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:03.742667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:03.743719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:03.744312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:03.961125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:03.971677 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-64df6b1c-3642-4269-a449-94b5c6c9c5e9 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.242815 May 27 19:55:03.974953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 392/728] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:03 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:04.114241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-d30ab288-5cab-42a6-b5a2-c296907b1842 req-a2257c88-a43d-4ac0-9311-39b6f47f019b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:04.123429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-d30ab288-5cab-42a6-b5a2-c296907b1842 req-a2257c88-a43d-4ac0-9311-39b6f47f019b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:04.123872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-d30ab288-5cab-42a6-b5a2-c296907b1842 req-a2257c88-a43d-4ac0-9311-39b6f47f019b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:04.137144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-d30ab288-5cab-42a6-b5a2-c296907b1842 req-a2257c88-a43d-4ac0-9311-39b6f47f019b service nova] Creating event network-changed:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:55:04.143108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-d30ab288-5cab-42a6-b5a2-c296907b1842 req-a2257c88-a43d-4ac0-9311-39b6f47f019b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032633 May 27 19:55:04.143905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 337/729] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:04.600674 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:04.601298 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:04.607799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:04.608244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:04.609092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:04.609553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:04.810736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:04.818982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:04.820511 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:04.821654 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-14b44628-09da-4bf9-8f90-6971fb5c340b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.224944 May 27 19:55:04.822220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 393/730] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:04 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:04.990462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:04.991892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:04.997403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:04.997850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:04.998647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:04.999074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:05.136009 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:05.144151 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7c205240-07c4-45bc-8d46-71dd57dae45b tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.158409 May 27 19:55:05.144733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 338/731] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:04 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:05.853986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:05.853986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:05.853986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:05.853986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:05.854822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:05.854822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:05.978804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:05.987360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:05.988846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:05.989971 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b9eb1465-cc72-4188-8200-cafbc0cd065e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.153830 May 27 19:55:05.990520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 394/732] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:05 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:06.166937 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:06.167464 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:06.173987 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:06.174433 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:06.175190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:06.175622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:06.309629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:06.317817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b651b910-7723-4a98-bea1-28898eb4c501 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.154795 May 27 19:55:06.318378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 339/733] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:06 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:07.007689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:07.008299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:07.014822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:07.015941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:07.016769 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:07.017247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:07.142299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:07.150177 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:07.151681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:07.152785 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a1fc2e9f-6657-40c3-b615-aca89afb633d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.149057 May 27 19:55:07.153454 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 395/734] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:07 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:07.334474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:07.335012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:07.341715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:07.342246 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:07.343549 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:07.343983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:07.482300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:07.490585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-cfdb12d1-e627-4a96-9bbe-87db9ffae384 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.160049 May 27 19:55:07.491150 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 340/735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:07 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:08.172008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:08.172621 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:08.178918 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:08.179368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:08.180135 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:08.180576 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:08.311231 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:08.319303 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:08.320814 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:08.321959 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c6afbb6b-9762-4bc2-a5fc-227ee8e9fadc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.154736 May 27 19:55:08.322524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 396/736] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:08 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:08.508910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:08.509466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:08.516886 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:08.517352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:08.518117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:08.518548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:08.662567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:08.669946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a6ab491e-ff64-4d39-940f-aba8c11ebcfe tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.165005 May 27 19:55:08.670501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 341/737] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:08 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:09.340020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:09.340614 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:09.347882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:09.348323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:09.349099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:09.349531 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:09.475117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:09.482898 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:09.484430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:09.485557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-213fe1b9-8063-432a-9640-c879c4b75536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.149622 May 27 19:55:09.486121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 397/738] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:09 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:09.687630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:09.688457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:09.694982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:09.695427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:09.696220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:09.696647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:09.804644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:09.826741 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:09.828962 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=12 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:09.834838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6c23dc8b-465b-40d0-9276-ea9eead884ff tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.151837 May 27 19:55:09.837495 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 342/739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:09 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:09.965398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-82119b02-27c6-4eee-9bd0-0f89bffbbf96 req-8d67f4b6-48cb-4c84-be5c-9a3984d2b138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "name": "network-vif-plugged", "status": "completed", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:09.973539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-82119b02-27c6-4eee-9bd0-0f89bffbbf96 req-8d67f4b6-48cb-4c84-be5c-9a3984d2b138 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:09.974027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-82119b02-27c6-4eee-9bd0-0f89bffbbf96 req-8d67f4b6-48cb-4c84-be5c-9a3984d2b138 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:09.985315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-82119b02-27c6-4eee-9bd0-0f89bffbbf96 req-8d67f4b6-48cb-4c84-be5c-9a3984d2b138 service nova] Creating event network-vif-plugged:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:55:09.990231 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-82119b02-27c6-4eee-9bd0-0f89bffbbf96 req-8d67f4b6-48cb-4c84-be5c-9a3984d2b138 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028940 May 27 19:55:09.997721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 398/740] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:10.503735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:10.504255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:10.511291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:10.511729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:10.512749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:10.513119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:10.517794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:10.652149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:10.661033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:10.662538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:10.663638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d19e3334-b7fb-461f-b412-06e23192e03e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.164440 May 27 19:55:10.664197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 343/741] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:10 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:10.849274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=8 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:10.853700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:10.854416 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:10.860572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:10.861032 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:10.861789 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:10.862218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:10.991260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:10.994676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:10.998997 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f89a4951-70fa-4a26-b79c-ee41ec8038e7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.150754 May 27 19:55:11.000347 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 399/742] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:10 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:11.681671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:11.682272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:11.689472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:11.689914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:11.690675 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:11.691110 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:11.822073 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:11.831597 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:11.833296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:11.834402 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-68da7a2e-f0b4-4905-a924-64149efde569 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1406 microversion: 2.20 time: 0.156606 May 27 19:55:11.834960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 344/743] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:11 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:55:12.017332 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:12.017938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:12.025909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.026273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.027065 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.027490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.158880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:12.166470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-720438ca-f7b2-46e2-8dc3-1368150385cb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.153703 May 27 19:55:12.167033 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 400/744] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:12 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:12.806696 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2c2f3d-3254-4980-836b-4284e58d4c78"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:12.807774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:12.815031 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.815472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.816231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.816663 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.853259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:12.853860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:12.860828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.861296 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.862052 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:12.862480 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:12.998629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:13.006599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:13.008084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:13.009252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-edeff777-9c47-483e-8fc4-f7630659c580 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1597 microversion: 2.20 time: 0.160095 May 27 19:55:13.009813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 401/745] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:55:12 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:55:13.027124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:13.027715 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:13.034562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:13.035100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:13.035860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:13.036293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:13.115766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e2dc01ff-dc35-43e1-a593-08a657823228 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092132 May 27 19:55:13.116384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 402/746] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 19:55:13 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 19:55:13.183357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:13.184127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:13.190968 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:13.191494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:13.192280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:13.192708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:13.410763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:13.418315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-08223e16-e889-4e2a-9c79-820244559f35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.238937 May 27 19:55:13.418885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 403/747] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:13 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:13.450388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5676344b-e777-4d28-9088-b8afdcbabc00 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647487 May 27 19:55:13.451297 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 345/748] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:55:12 2022] POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:13.971939 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3cff4d72-96e4-4e5c-9d70-7961a958914e req-632f303b-ce9c-49bb-af54-77850daefc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "name": "network-vif-plugged", "status": "completed", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:13.980360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3cff4d72-96e4-4e5c-9d70-7961a958914e req-632f303b-ce9c-49bb-af54-77850daefc44 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:13.980806 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3cff4d72-96e4-4e5c-9d70-7961a958914e req-632f303b-ce9c-49bb-af54-77850daefc44 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:13.991911 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3cff4d72-96e4-4e5c-9d70-7961a958914e req-632f303b-ce9c-49bb-af54-77850daefc44 service nova] Creating event network-vif-plugged:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:55:13.996776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3cff4d72-96e4-4e5c-9d70-7961a958914e req-632f303b-ce9c-49bb-af54-77850daefc44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 May 27 19:55:13.997444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 404/749] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:14.436740 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:14.438781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:14.446904 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:14.447424 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:14.448348 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:14.449189 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:14.462467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-33d98705-c7ba-44ec-ba65-1ffb3b9bbc3c req-0d4f8dcc-b39a-41b0-9f78-0e7f0722e08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:14.476250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-33d98705-c7ba-44ec-ba65-1ffb3b9bbc3c req-0d4f8dcc-b39a-41b0-9f78-0e7f0722e08d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:14.476772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-33d98705-c7ba-44ec-ba65-1ffb3b9bbc3c req-0d4f8dcc-b39a-41b0-9f78-0e7f0722e08d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:14.490091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-33d98705-c7ba-44ec-ba65-1ffb3b9bbc3c req-0d4f8dcc-b39a-41b0-9f78-0e7f0722e08d service nova] Creating event network-changed:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:55:14.495645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-33d98705-c7ba-44ec-ba65-1ffb3b9bbc3c req-0d4f8dcc-b39a-41b0-9f78-0e7f0722e08d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038920 May 27 19:55:14.496476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 405/750] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:14.598058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:14.605635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-69d4e92d-fd05-4c42-8a66-40f0cf0ebcc2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.173180 May 27 19:55:14.606202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 346/751] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:14 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:15.623551 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:15.624241 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:15.633558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:15.634233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:15.635022 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:15.635461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:15.882388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:15.890018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-97de745b-7e64-4c5e-8e7c-a74f9f2b0d73 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1257 microversion: 2.1 time: 0.271111 May 27 19:55:15.891162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 406/752] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:15 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1257 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:16.907849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:16.908451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:16.915045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:16.915488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:16.916243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:16.916672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:17.100370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:17.108054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c912e133-3adb-4539-92db-790cbc5b5446 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1441 microversion: 2.1 time: 0.204681 May 27 19:55:17.108610 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 347/753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:16 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1441 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:17.123800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:17.124916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:17.132259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:17.132697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:17.133520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:17.133946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:17.263319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:17.271908 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6f35c2a9-0465-4283-9067-75886690bc15 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1441 microversion: 2.1 time: 0.151901 May 27 19:55:17.272468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 407/754] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:17 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:17.931036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:17.931581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:17.933879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:17.938574 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:17.939638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:17.940589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:17.941057 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:17.964719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f2ae7072-8c9d-4ebc-a882-2b19c1aec03a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/ips" status: 200 len: 150 microversion: 2.1 time: 0.037335 May 27 19:55:17.965440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 348/755] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:55:17 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:19.396339 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1e14e46d-f3db-4bac-9acc-3a3b6de897bf req-f0943198-5d73-47a9-a60a-1876c77b7333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:19.400609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:19.405920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1e14e46d-f3db-4bac-9acc-3a3b6de897bf req-f0943198-5d73-47a9-a60a-1876c77b7333 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:19.406359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1e14e46d-f3db-4bac-9acc-3a3b6de897bf req-f0943198-5d73-47a9-a60a-1876c77b7333 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:19.417550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1e14e46d-f3db-4bac-9acc-3a3b6de897bf req-f0943198-5d73-47a9-a60a-1876c77b7333 service nova] Creating event network-changed:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:55:19.422706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1e14e46d-f3db-4bac-9acc-3a3b6de897bf req-f0943198-5d73-47a9-a60a-1876c77b7333 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029991 May 27 19:55:19.423723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 408/756] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:19.544430 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d36b96-bc2e-4c4f-874e-972eda4317d5"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:19.545725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:19.553088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:19.553530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:19.554285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:19.554715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:20.228493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d976da2f-604b-401f-855d-15ee52e04a68 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688123 May 27 19:55:20.229442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 349/757] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:55:19 2022] POST /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:20.971265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:20.972324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:20.978950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:20.979396 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:20.980162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:20.980599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:21.002667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'flavor' on Instance uuid 91fb7b5c-926e-46ee-b703-45ad20c41a26 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:55:21.289931 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4ff28cd7-ec8b-4f7e-9e55-40696f624492 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/action" status: 200 len: 32 microversion: 2.1 time: 0.323561 May 27 19:55:21.290453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 409/758] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:55:20 2022] POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 19:55:21.300737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:21.301461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:21.309215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:21.309672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:21.310453 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:21.310887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:21.446010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:21.454098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0978d705-ff76-498a-ac45-26d2095b541d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.158235 May 27 19:55:21.454665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 350/759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:21 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:22.472131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:22.472757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:22.479554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:22.479999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:22.480759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:22.481216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:22.610780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:22.619653 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-41e4f4a1-9b4a-4dd5-8971-0d01165ea87b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.151865 May 27 19:55:22.620212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 410/760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:22 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:23.636960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:23.637598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:23.644097 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:23.644540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:23.645328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:23.645766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:23.776486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:23.784445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-40000ff3-3f9b-40a5-bc0a-f075d8187c1f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.151322 May 27 19:55:23.785019 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 351/761] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:23 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:24.801747 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:24.802293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:24.808893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:24.809376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:24.810145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:24.810587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:24.943219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:24.951622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-68b28b8d-7b16-4c58-b805-0b9633f9eff7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.154485 May 27 19:55:24.952310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 411/762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:24 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:25.969335 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:25.976485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:25.978296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:25.978874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:25.979705 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:25.980134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:26.115272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:26.124241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b7fbfd2d-3927-400d-8552-c07b4c26e734 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.159160 May 27 19:55:26.124808 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 352/763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:25 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:27.142007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:27.142580 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:27.149501 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:27.149943 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:27.150700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:27.151125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:27.279222 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:27.288274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e8017d75-7dc9-44c1-b047-1fd6312e64d8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.150137 May 27 19:55:27.288893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 412/764] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:27 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:27.885409 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6d36b96-bc2e-4c4f-874e-972eda4317d5"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:27.886522 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:27.893019 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:27.893467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:27.894258 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:27.894825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:27.972065 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: POST /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments HTTP/1.1 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 74 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:55:27.973789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {"volumeAttachment": {"volumeId": "c6d36b96-bc2e-4c4f-874e-972eda4317d5"}} May 27 19:55:27.975428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'server_id': '103930b7-69c6-42cc-89de-8f69b48c79d8', 'body': {'volumeAttachment': {'volumeId': 'c6d36b96-bc2e-4c4f-874e-972eda4317d5'}}} May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:27.976242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:27.977514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 400 to user: Invalid volume: volume c6d36b96-bc2e-4c4f-874e-972eda4317d5 is already attached to instances: 103930b7-69c6-42cc-89de-8f69b48c79d8 {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d8c4edfd-2f0f-4427-9b1d-3e5746783906 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093805 May 27 19:55:27.978760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 353/765] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:55:27 2022] POST /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 19:55:28.037518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:28.037942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:28.044022 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.044467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.045254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.045692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.126060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'services' on Instance uuid 103930b7-69c6-42cc-89de-8f69b48c79d8 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:55:28.306465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:28.306465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:28.312181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.312712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.313504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.313941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.336092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e8b1436f-f50c-4a9d-9afe-dc9f2a74b4bb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments/c6d36b96-bc2e-4c4f-874e-972eda4317d5" status: 202 len: 0 microversion: 2.1 time: 0.302655 May 27 19:55:28.341084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 413/766] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:55:28 2022] DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments/c6d36b96-bc2e-4c4f-874e-972eda4317d5 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:55:28.345865 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:28.346974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:28.354228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.354678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.355462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:28.355903 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:28.387272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0e61d2c7-f107-4d60-8c67-50f6772eed51 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 May 27 19:55:28.387984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 414/767] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:55:28 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:28.455975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:28.464720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8394bf47-7b81-4753-8869-c6999a785ec8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.163402 May 27 19:55:28.465460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 354/768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:28 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:29.399462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:29.400388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:29.406908 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.407356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.408129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.408550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.440800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-420f279b-8046-4f7d-94fd-348388b91301 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045503 May 27 19:55:29.443888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 415/769] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:55:29 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 19:55:29.482656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:29.483333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:29.495033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.501423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.501423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.501423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.508565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:29.509093 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:29.515562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.516006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.516764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.517395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.526754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:29.546147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:55:29.632457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:29.641342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bbee7422-25a1-4262-8d42-f9987b78f0a7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.161557 May 27 19:55:29.641342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 355/770] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:29 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:29.857109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-21022220-3389-4b1f-a5ac-ccfa1d767788 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 204 len: 0 microversion: 2.1 time: 0.352793 May 27 19:55:29.857704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 416/771] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:55:29 2022] DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 19:55:29.867585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:29.869635 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:29.874970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.875414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:29.876168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:29.876725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:30.005478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:30.014206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8a32d160-72e2-4848-824f-51f5498f83d3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1683 microversion: 2.1 time: 0.151948 May 27 19:55:30.014766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 356/772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:29 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:30.470307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-555282303"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:30.470858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:30.477375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:30.477823 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:30.478593 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:30.479027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:30.606970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.network.security_group_api [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Removing security group 043f6af8-2169-4049-88ef-15e143b2a5b5 from port 303186bb-8e3b-42d5-a8e3-68fba189c88d May 27 19:55:30.657810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:30.658402 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:30.665670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:30.666119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:30.666891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:30.667332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:30.686733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:30.804596 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:30.812765 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-04efe2c6-68dc-4b9e-ba5c-e29055736bf7 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.158939 May 27 19:55:30.813361 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 357/773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:30 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:31.032337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:31.033223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:31.040222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:31.040796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:31.041704 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:31.042876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:31.063364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e56241c3-71ec-4e93-a08d-dae6904a0869 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action" status: 202 len: 0 microversion: 2.1 time: 0.596759 May 27 19:55:31.063987 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 417/774] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:55:30 2022] POST /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:55:31.080184 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-93e33791-dc03-46de-8f3d-d4d8963ed5c4 req-3a4b749e-cf84-44bb-80f8-0fff3642a668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:31.095967 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-93e33791-dc03-46de-8f3d-d4d8963ed5c4 req-3a4b749e-cf84-44bb-80f8-0fff3642a668 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:31.098914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-93e33791-dc03-46de-8f3d-d4d8963ed5c4 req-3a4b749e-cf84-44bb-80f8-0fff3642a668 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:31.112331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-93e33791-dc03-46de-8f3d-d4d8963ed5c4 req-3a4b749e-cf84-44bb-80f8-0fff3642a668 service nova] Creating event network-changed:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:55:31.122863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-93e33791-dc03-46de-8f3d-d4d8963ed5c4 req-3a4b749e-cf84-44bb-80f8-0fff3642a668 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044841 May 27 19:55:31.122863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 418/775] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:31.324144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:31.332788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-30bb78e0-8182-4d63-9333-89b2bc610865 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1683 microversion: 2.1 time: 0.304443 May 27 19:55:31.333425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 358/776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:31 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1683 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:31.831268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:31.832673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:31.840231 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:31.841023 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:31.842020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:31.842554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:32.155613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:32.166478 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7b82a245-1756-4ba8-98d3-91b8833bca0f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.339744 May 27 19:55:32.167342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 419/777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:31 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:32.350979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:32.352906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:32.360366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:32.360975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:32.362726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:32.364054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:32.443797 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:32.451695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b664ecab-05ae-42d2-82ea-f5dcfe3814ae tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1615 microversion: 2.1 time: 0.104857 May 27 19:55:32.452462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 359/778] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:32 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:32.871243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-e884823a-06c7-4d29-b1b6-5c18943b0faf req-09d94acd-eaf9-437b-923d-16bed1f3f280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "103930b7-69c6-42cc-89de-8f69b48c79d8", "name": "network-vif-deleted", "tag": "ea65af22-78c0-4852-9eaa-a6db38529d3a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:32.881805 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-e884823a-06c7-4d29-b1b6-5c18943b0faf req-09d94acd-eaf9-437b-923d-16bed1f3f280 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:32.882156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-e884823a-06c7-4d29-b1b6-5c18943b0faf req-09d94acd-eaf9-437b-923d-16bed1f3f280 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:32.894020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-e884823a-06c7-4d29-b1b6-5c18943b0faf req-09d94acd-eaf9-437b-923d-16bed1f3f280 service nova] Creating event network-vif-deleted:ea65af22-78c0-4852-9eaa-a6db38529d3a for instance 103930b7-69c6-42cc-89de-8f69b48c79d8 on hv-cinder-83979 May 27 19:55:32.899693 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-e884823a-06c7-4d29-b1b6-5c18943b0faf req-09d94acd-eaf9-437b-923d-16bed1f3f280 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 May 27 19:55:32.900866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 420/779] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:33.067547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:33.071211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:33.074921 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.075588 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.076369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.076837 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.155759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-ef316ea4-5a6d-4bb6-af96-7f90724f80ec req-de05a7dd-a58d-412d-af1b-4c6890886968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:33.168364 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-ef316ea4-5a6d-4bb6-af96-7f90724f80ec req-de05a7dd-a58d-412d-af1b-4c6890886968 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.168815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-ef316ea4-5a6d-4bb6-af96-7f90724f80ec req-de05a7dd-a58d-412d-af1b-4c6890886968 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.183404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-ef316ea4-5a6d-4bb6-af96-7f90724f80ec req-de05a7dd-a58d-412d-af1b-4c6890886968 service nova] Creating event network-changed:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:55:33.188800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-ef316ea4-5a6d-4bb6-af96-7f90724f80ec req-de05a7dd-a58d-412d-af1b-4c6890886968 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038597 May 27 19:55:33.189856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 421/780] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:33.197509 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:33.205742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:33.218242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.220219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.220219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.220687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.247422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lazy-loading 'services' on Instance uuid 66cd5c3e-4918-418f-8f73-3a8e712f940e {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:55:33.420723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:33.428809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4b71be9e-f28c-470b-8f44-1b4c0fabd583 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.237770 May 27 19:55:33.430178 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 422/781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:33 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:33.470189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:33.470817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:33.480130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.480863 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.481694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.482142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.531692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.532139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.532598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'fault' on Instance uuid 103930b7-69c6-42cc-89de-8f69b48c79d8 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:55:33.546328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-981be1b6-205c-4351-8e71-95f8413cd9d5 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments/f8561f19-eb76-4add-a193-40ff630be144" status: 202 len: 0 microversion: 2.1 time: 0.482346 May 27 19:55:33.552770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 360/782] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:55:33 2022] DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments/f8561f19-eb76-4add-a193-40ff630be144 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:55:33.582651 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:33.584714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:33.605672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.606154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:33.607014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.608512 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:33.609207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:33.615195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9a513476-f9b3-4372-bf7e-2ff170bb3472 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 200 len: 1332 microversion: 2.1 time: 0.148982 May 27 19:55:33.621157 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 423/783] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:33 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 1332 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:33.656861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-494031e5-7ad7-48ed-b2d6-8e65af1f4ff7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089616 May 27 19:55:33.658014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 361/784] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:55:33 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:34.446697 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:34.447306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:34.453880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.454333 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.455088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.455525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.589998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:34.598073 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-11c2ee88-803c-4bd8-9291-de13ff7dffee tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.155363 May 27 19:55:34.598738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 424/785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:34 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:34.633128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:34.633830 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:34.640407 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.640977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.641828 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.642364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.656257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 HTTP/1.1 May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:55:34.657930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:55:34.659465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '103930b7-69c6-42cc-89de-8f69b48c79d8'} May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:55:34.660390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:55:34.661884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:34.663458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:55:34.663458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c00d5550-eed6-4f6d-a31f-d236ece97ccf tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 404 len: 111 microversion: 2.1 time: 0.030799 May 27 19:55:34.663458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 362/786] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:34 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:55:34.669769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:34.670970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:34.674631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0ba11f4a-ab51-420f-b78a-d2d9c25da534 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '.version_select at 0x7fe1b46d8af0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:34.678773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.679222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.679991 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:34.680432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:34.709674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b2bbb356-3373-4843-a116-fd7f9476a99d tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 May 27 19:55:34.710144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 363/787] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:55:34 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:34.869213 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0ba11f4a-ab51-420f-b78a-d2d9c25da534 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990486228" status: 202 len: 0 microversion: 2.1 time: 0.198256 May 27 19:55:34.869803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 425/788] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 19:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990486228 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:55:35.576192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c44eb871-6654-4873-baa4-0a073e14d230 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: .version_select at 0x7fe1b48819d0>, body: {"keypair": {"name": "tempest-keypair-263872067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeJC0H0vTq2CvCULLCVQH3tKwl6f4ZijsNTNQ/r7wcrgC7hCjvy0TyyJjT1nq+DLjv5vclTfMWh3UVZucd+AixET7LuSz4Pmxvj4K8gSSkQhP91JqBrbL8iHwxM0TliHw=="}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:35.590749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-c44eb871-6654-4873-baa4-0a073e14d230 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:55:35.594440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-c44eb871-6654-4873-baa4-0a073e14d230 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:55:35.615243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:35.616011 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:35.622485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.622928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.623826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.624269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.681189 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c44eb871-6654-4873-baa4-0a073e14d230 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108783 May 27 19:55:35.682125 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 364/789] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:55:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:35.721215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:35.722030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:35.729363 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.729896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.730759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.731275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.756749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:35.760541 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4c3121e4-f5d7-4cdd-8bd4-e97ec02a6db7 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043348 May 27 19:55:35.761161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 365/790] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:55:35 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 19:55:35.764870 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-df24b1c2-d7c5-41a7-84be-17b57aa5f83d tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.153770 May 27 19:55:35.765467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 426/791] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:35 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:35.771569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:35.772051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:35.778129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.778619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.779514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:35.779947 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:35.857154 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] HTTP exception thrown: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e is not attached to volume f8561f19-eb76-4add-a193-40ff630be144 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Request method failure captured: May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments/f8561f19-eb76-4add-a193-40ff630be144 HTTP/1.1 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvMcu77E9cgwsCDB0KC3m_Psj-S6_d1k6r0hGzKwMLbyADkRImelAbjcZyHFSgHV6rPLXWYbAOt4WlN6QxXB6KKeaGnz6g-MN4MC659_yjrCInlQP3dzPYU4AItnselBE3dkEZ4O__uhH10MKjdSADagmhsXrKtucHqvqKKwmSY6HU May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 0ca4fe16a0204d0db4289e293771581b May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:55:35.862893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ca4fe16a0204d0db4289e293771581b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ca4fe16a0204d0db4289e293771581b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0ca4fe16a0204d0db4289e293771581b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0ca4fe16a0204d0db4289e293771581b"}]}] May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 0ca4fe16a0204d0db4289e293771581b May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-TestMinimumBasicScenario-1907619667-project May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: c0f12003099f4f80bb89c2a335d231ca May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-TestMinimumBasicScenario-1907619667-project May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:55:35.864759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e is not attached to volume f8561f19-eb76-4add-a193-40ff630be144 May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'server_id': '66cd5c3e-4918-418f-8f73-3a8e712f940e', 'id': 'f8561f19-eb76-4add-a193-40ff630be144'} May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f8561f19-eb76-4add-a193-40ff630be144. May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:55:35.865660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e is not attached to volume f8561f19-eb76-4add-a193-40ff630be144 May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e is not attached to volume f8561f19-eb76-4add-a193-40ff630be144 May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:35.867059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Returning 404 to user: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e is not attached to volume f8561f19-eb76-4add-a193-40ff630be144 {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:55:35.868201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2cae370d-4d9e-4004-b2e8-75f0fa3d2e51 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments/f8561f19-eb76-4add-a193-40ff630be144" status: 404 len: 154 microversion: 2.1 time: 0.097383 May 27 19:55:35.868201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 366/792] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:55:35 2022] DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e/os-volume_attachments/f8561f19-eb76-4add-a193-40ff630be144 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:55:36.783006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:36.783619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:36.790846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:36.791297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:36.792067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:36.792503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:36.925376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:36.934091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a7f10295-5063-45ea-86b2-2a0c3ca23c63 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.154927 May 27 19:55:36.934661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 427/793] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:36 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:37.142453 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:37.142951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:37.149920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.150370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:37.151145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.151582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:37.181689 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:55:37.491286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6e1b14dd-1203-4b06-b988-be439d2e91d8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 204 len: 0 microversion: 2.1 time: 0.352401 May 27 19:55:37.492001 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 367/794] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:55:37 2022] DELETE /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:55:37.500438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:37.501126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:37.507679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.508215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:37.509098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.509605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:37.642436 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:37.650945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-68c57f62-4183-44f3-892a-4bd1ae7a1886 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1554 microversion: 2.1 time: 0.154527 May 27 19:55:37.651515 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 428/795] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:37 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:37.763173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-499144559", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc686edf-9590-4ae1-ab4c-4d4524b126ab"}], "security_groups": [{"name": "tempest-securitygroup--436394717"}], "key_name": "tempest-keypair-263872067", "user_data": "}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:37.865406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] validate_networks() for [('dc686edf-9590-4ae1-ab4c-4d4524b126ab', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:55:37.951720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:37.952357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:37.958443 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.958891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:37.959660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:37.960091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:38.090676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:38.100189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8996ba87-3ff3-459f-b364-0a78b18d2e24 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.152281 May 27 19:55:38.100757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 429/796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:37 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:38.285220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:55:38.286250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:55:38.286786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:55:38.287197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:55:38.287607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:55:38.296429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:38.301518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:38.301518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:38.301518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:38.315196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:55:38.319177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Getting quotas for user 3c9aa6527c13466bbe5dce68a3b81ab5 and project c994c57a63464397bd567b97dbc3097e. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:55:38.330152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:55:38.333003 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:55:38.492010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9797dd38-c8be-48cc-a07f-6795845432ee tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.733396 May 27 19:55:38.492654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 368/797] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:55:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 19:55:38.502691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2f81246e-bf0f-4b5a-819a-f3a4d2ad8f06 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:38.503295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2f81246e-bf0f-4b5a-819a-f3a4d2ad8f06 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:38.563570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2f81246e-bf0f-4b5a-819a-f3a4d2ad8f06 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:38.571139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2f81246e-bf0f-4b5a-819a-f3a4d2ad8f06 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1240 microversion: 2.1 time: 0.072216 May 27 19:55:38.571706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 430/798] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:38 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:38.668654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:38.669372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:38.675619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:38.676742 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:38.677607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:38.678045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:38.813858 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:38.821483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1ee7d92b-576f-4cf9-8d5c-be010da84d9f tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1554 microversion: 2.1 time: 0.156791 May 27 19:55:38.822075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 369/799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:38 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:39.118279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:39.118887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:39.124915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.125393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.126162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.126598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.255514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:39.263494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9ca3db12-4edb-4741-b575-6df46443c231 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.149124 May 27 19:55:39.264061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 431/800] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:39 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:39.588970 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:39.589593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:39.596110 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.596563 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.597362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.597801 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.660819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:39.668239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bfaec51e-473e-495b-8cb9-81670f83f655 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1244 microversion: 2.1 time: 0.083356 May 27 19:55:39.668821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 370/801] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:39 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:39.840612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:39.841312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:39.847973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.849614 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.849614 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:39.849803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:39.979848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:39.987485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-41aa6d9a-d192-4604-b372-ffe3000a485a tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1554 microversion: 2.1 time: 0.152572 May 27 19:55:39.988057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 432/802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:39 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:40.281250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:40.281843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:40.287901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:40.290454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:40.290454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:40.290454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:40.416472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:40.424298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-426b3926-8c7b-40cf-839e-1f13567a75e2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.146942 May 27 19:55:40.424851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 371/803] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:40 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:40.685338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:40.685974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:40.694694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:40.695388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:40.696340 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:40.697193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:40.777558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:40.785097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d319e636-27cc-44d2-bf78-1b920aef4135 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1236 microversion: 2.1 time: 0.103661 May 27 19:55:40.785724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 433/804] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:40 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:41.004783 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:41.005565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:41.012045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.012515 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.013301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.013730 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.106072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:41.115526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-570fa622-6f97-424f-8102-5f447fae18ea tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1512 microversion: 2.1 time: 0.115045 May 27 19:55:41.122756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 372/805] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:40 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1512 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:41.159095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-fa515cfb-6c01-4cde-8658-3414188b1b98 req-c1116d97-1c7f-4a3e-be26-0d8cb2529cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd5c3e-4918-418f-8f73-3a8e712f940e", "name": "network-vif-deleted", "tag": "303186bb-8e3b-42d5-a8e3-68fba189c88d"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:41.168085 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-fa515cfb-6c01-4cde-8658-3414188b1b98 req-c1116d97-1c7f-4a3e-be26-0d8cb2529cc6 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.168525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-fa515cfb-6c01-4cde-8658-3414188b1b98 req-c1116d97-1c7f-4a3e-be26-0d8cb2529cc6 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.179921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-fa515cfb-6c01-4cde-8658-3414188b1b98 req-c1116d97-1c7f-4a3e-be26-0d8cb2529cc6 service nova] Creating event network-vif-deleted:303186bb-8e3b-42d5-a8e3-68fba189c88d for instance 66cd5c3e-4918-418f-8f73-3a8e712f940e on hv-cinder-83979 May 27 19:55:41.184852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-fa515cfb-6c01-4cde-8658-3414188b1b98 req-c1116d97-1c7f-4a3e-be26-0d8cb2529cc6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 May 27 19:55:41.185506 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 434/806] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:41.441882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:41.442596 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:41.449329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.449813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.450775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.451377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.604408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:41.612414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f0868965-f927-4525-8e1e-2dc85596ac2b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1735 microversion: 2.1 time: 0.174502 May 27 19:55:41.613314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 373/807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:41 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:41.803817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:41.804358 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:41.810746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.811199 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.811972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:41.812410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:41.878106 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:41.881799 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:41.886088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-55ef35a6-df1c-4dfe-9eb1-a72e1da18f42 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1292 microversion: 2.1 time: 0.087434 May 27 19:55:41.886652 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 435/808] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:41 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:42.131997 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:42.132547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:42.147625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.148069 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.148833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.149291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.156583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:42.185143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.185586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.186032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lazy-loading 'fault' on Instance uuid 66cd5c3e-4918-418f-8f73-3a8e712f940e {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:55:42.227913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f12003099f4f80bb89c2a335d231ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca4fe16a0204d0db4289e293771581b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:42.235530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9f483241-1398-4a60-83d9-ddda4043ef11 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 200 len: 1348 microversion: 2.1 time: 0.107796 May 27 19:55:42.236347 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 374/809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:42 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:42.631749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:42.635648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:42.639272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.639728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.640504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.640944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.775625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:42.783851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-272cffe7-15fb-4716-a6f9-58eaed9e6a7e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1715 microversion: 2.1 time: 0.156829 May 27 19:55:42.784546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 436/810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:42 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:42.890301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:42.890884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:42.898135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.898667 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.899578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.900027 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.903913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:42.904524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:42.911507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.911956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.912730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:42.913195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:42.987386 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:42.991514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] HTTP exception thrown: Cannot 'detach_volume' instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 while it is in vm_state rescued May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Request method failure captured: May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments/6c2c2f3d-3254-4980-836b-4284e58d4c78 HTTP/1.1 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvN-7XXjSH7cWkPu1kJRy1a-_svyOKCeQu57zkfa_0KkJ9ATvvYtFztWlGhENwRPv5g1Z8IyfwdHWfbFAtDcnGJZfU5N8fICy34QpfXtXZR83qv8i4QDM3or5ds5dfkISvzGf06rPDDL07QqGHU1PUNUHQz9NOP2YfFxGgeRiIXldk May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:55:42.992750 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3388fd386824477385e3ad6baa4cae56", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3388fd386824477385e3ad6baa4cae56"}]}] May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a13d2c50c5204c859872e99bc45c6566 May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:55:42.994367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Cannot 'detach_volume' instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 while it is in vm_state rescued May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'server_id': '91fb7b5c-926e-46ee-b703-45ad20c41a26', 'id': '6c2c2f3d-3254-4980-836b-4284e58d4c78'} May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:55:42.995525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 while it is in vm_state rescued May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 while it is in vm_state rescued May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:42.997102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Returning 409 to user: Cannot 'detach_volume' instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 while it is in vm_state rescued {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:55:42.998673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-96d317a6-7710-4357-af7a-164415efff77 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments/6c2c2f3d-3254-4980-836b-4284e58d4c78" status: 409 len: 152 microversion: 2.1 time: 0.108049 May 27 19:55:42.998673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 375/811] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:55:42 2022] DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments/6c2c2f3d-3254-4980-836b-4284e58d4c78 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 19:55:42.998856 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-92dd89d5-0ef3-4694-8a7c-68e02d197dc9 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1298 microversion: 2.1 time: 0.098953 May 27 19:55:43.001074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 437/812] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:42 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:55:43.003319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:43.003878 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:43.011496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.011951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.014624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.014624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.202404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-56054aa9-f83f-4f87-9ba9-ce9a87f18d40 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/action" status: 202 len: 0 microversion: 2.1 time: 0.202881 May 27 19:55:43.203385 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 376/813] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:55:42 2022] POST /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 19:55:43.212719 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:43.213712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:43.220094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.220637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.221647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.222305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.253593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:43.255155 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] [instance: 66cd5c3e-4918-418f-8f73-3a8e712f940e] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:43.265797 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.274373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.274373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:43.274373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:43.282624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] HTTP exception thrown: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Request method failure captured: May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e HTTP/1.1 May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvMcu77E9cgwsCDB0KC3m_Psj-S6_d1k6r0hGzKwMLbyADkRImelAbjcZyHFSgHV6rPLXWYbAOt4WlN6QxXB6KKeaGnz6g-MN4MC659_yjrCInlQP3dzPYU4AItnselBE3dkEZ4O__uhH10MKjdSADagmhsXrKtucHqvqKKwmSY6HU May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 0ca4fe16a0204d0db4289e293771581b May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:55:43.284511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ca4fe16a0204d0db4289e293771581b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0ca4fe16a0204d0db4289e293771581b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0ca4fe16a0204d0db4289e293771581b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0ca4fe16a0204d0db4289e293771581b"}]}] May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 0ca4fe16a0204d0db4289e293771581b May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1907619667 May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-TestMinimumBasicScenario-1907619667-project May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: c0f12003099f4f80bb89c2a335d231ca May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-TestMinimumBasicScenario-1907619667-project May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. May 27 19:55:43.286516 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '66cd5c3e-4918-418f-8f73-3a8e712f940e'} May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:55:43.287460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. May 27 19:55:43.289084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:55:43.290999 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Returning 404 to user: Instance 66cd5c3e-4918-418f-8f73-3a8e712f940e could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:55:43.291992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5b2debd1-2903-4901-8628-40f1d56426e8 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e" status: 404 len: 111 microversion: 2.1 time: 0.044183 May 27 19:55:43.292864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 377/814] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:43 2022] GET /compute/v2.1/servers/66cd5c3e-4918-418f-8f73-3a8e712f940e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 19:55:43.303525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-228b2cb2-57dd-44f9-bfa5-6d4bdba98b32 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] Calling method '.version_select at 0x7fe1b48a03a0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:43.384267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-228b2cb2-57dd-44f9-bfa5-6d4bdba98b32 tempest-TestMinimumBasicScenario-1907619667 tempest-TestMinimumBasicScenario-1907619667-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1632819889" status: 202 len: 0 microversion: 2.1 time: 0.087396 May 27 19:55:43.385213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 378/815] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 19:55:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1632819889 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:55:43.437679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:43.448256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-249ad9d9-d867-4026-aab1-1644cf63b977 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1723 microversion: 2.1 time: 0.240740 May 27 19:55:43.449692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 438/816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:43 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:44.024053 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:44.025007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:44.031275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:44.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:44.032634 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:44.033099 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:44.059553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-49d2d2ab-138e-4151-9b19-d249dd9168c4 req-717fc16a-b070-4cdf-8baa-a4b41fe0cf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb04690-f1fd-4202-8dbf-792d9e5f2dec", "tag": "c5f16c13-944f-4c67-956e-bbc4da9c8011"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:44.075499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-49d2d2ab-138e-4151-9b19-d249dd9168c4 req-717fc16a-b070-4cdf-8baa-a4b41fe0cf31 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:44.075941 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-49d2d2ab-138e-4151-9b19-d249dd9168c4 req-717fc16a-b070-4cdf-8baa-a4b41fe0cf31 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:44.100377 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-49d2d2ab-138e-4151-9b19-d249dd9168c4 req-717fc16a-b070-4cdf-8baa-a4b41fe0cf31 service nova] Creating event network-changed:c5f16c13-944f-4c67-956e-bbc4da9c8011 for instance efb04690-f1fd-4202-8dbf-792d9e5f2dec on hv-cinder-83979 May 27 19:55:44.105648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-49d2d2ab-138e-4151-9b19-d249dd9168c4 req-717fc16a-b070-4cdf-8baa-a4b41fe0cf31 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049610 May 27 19:55:44.106510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 439/817] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:44.233357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:44.250180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f8339ff0-ef6a-4ebe-b547-7f638552b28a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.228978 May 27 19:55:44.253437 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 379/818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:44 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:44.466759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:44.467463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:44.474021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:44.474477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:44.475247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:44.475688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:44.609046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:44.617669 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9870144f-ece0-43c1-b3bb-05a45f5bca32 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1723 microversion: 2.1 time: 0.155522 May 27 19:55:44.618230 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 440/819] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:44 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:45.265948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:45.266554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:45.269039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:45.274336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:45.274936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:45.275761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:45.276198 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:45.484747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:45.492391 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-55ba0e3a-9471-4791-94a3-5e57eb564c63 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.230399 May 27 19:55:45.492977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 380/820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:45 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:45.637244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:45.638103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:45.646122 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:45.646783 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:45.647807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:45.648481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:45.845566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:45.853699 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b29fdbc2-d1a4-4c26-9ffa-5f864e727be3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1723 microversion: 2.1 time: 0.221834 May 27 19:55:45.854419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 441/821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:45 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:46.510810 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:46.511990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:46.520351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:46.521762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:46.522771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:46.523372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:46.671496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:46.680882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-eb65cb60-1062-436a-bb65-d074036652ad tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.174748 May 27 19:55:46.681740 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 381/822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:46 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:46.872346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:46.873598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:46.880659 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:46.881146 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:46.882060 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:46.882501 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:47.029685 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:47.038216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-305dbc14-6da4-4a2c-9ea8-d655383aff23 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1729 microversion: 2.1 time: 0.170259 May 27 19:55:47.038798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 442/823] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:46 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:47.054849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:47.055265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:47.061368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:47.061814 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:47.066880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:47.066880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:47.144006 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-707f064b-7f9f-46f0-99ee-f9bfe4d6a185 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093226 May 27 19:55:47.145290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 382/824] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:55:47 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:47.698634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:47.699679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:47.712630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:47.713164 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:47.714521 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:47.715209 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:47.906780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:47.918974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bbec6d3d-b845-456b-8a8a-b3380a1c16c1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.224105 May 27 19:55:47.920069 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 443/825] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:47 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:48.444024 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:48.445715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=10 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:48.449891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-e672435f-a03a-4f8c-a076-40de8e92540b req-8e9fdd2e-aa2e-40b7-b914-826c57c6a072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:48.463553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-e672435f-a03a-4f8c-a076-40de8e92540b req-8e9fdd2e-aa2e-40b7-b914-826c57c6a072 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:48.464263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-e672435f-a03a-4f8c-a076-40de8e92540b req-8e9fdd2e-aa2e-40b7-b914-826c57c6a072 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:48.483362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-e672435f-a03a-4f8c-a076-40de8e92540b req-8e9fdd2e-aa2e-40b7-b914-826c57c6a072 service nova] Creating event network-changed:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:55:48.493217 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-e672435f-a03a-4f8c-a076-40de8e92540b req-8e9fdd2e-aa2e-40b7-b914-826c57c6a072 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049889 May 27 19:55:48.498290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 383/826] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:48.936048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:48.944994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:48.947486 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:48.951557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:48.954984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:48.956463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:48.957836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:49.173088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:49.184847 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-19ebd4b0-5f46-422b-aa63-b51f6aa7a88a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.252167 May 27 19:55:49.187010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 444/827] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:48 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:50.211154 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:50.211872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:50.218830 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:50.219706 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:50.220919 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:50.221577 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:50.273397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3a04cb01-555e-4ee5-8728-54a16f3657a4 req-61630cd1-6948-43da-aed9-8052d0b0552d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb04690-f1fd-4202-8dbf-792d9e5f2dec", "name": "network-vif-plugged", "status": "completed", "tag": "c5f16c13-944f-4c67-956e-bbc4da9c8011"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:50.286194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3a04cb01-555e-4ee5-8728-54a16f3657a4 req-61630cd1-6948-43da-aed9-8052d0b0552d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:50.286804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3a04cb01-555e-4ee5-8728-54a16f3657a4 req-61630cd1-6948-43da-aed9-8052d0b0552d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:50.299124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3a04cb01-555e-4ee5-8728-54a16f3657a4 req-61630cd1-6948-43da-aed9-8052d0b0552d service nova] Creating event network-vif-plugged:c5f16c13-944f-4c67-956e-bbc4da9c8011 for instance efb04690-f1fd-4202-8dbf-792d9e5f2dec on hv-cinder-83979 May 27 19:55:50.309797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3a04cb01-555e-4ee5-8728-54a16f3657a4 req-61630cd1-6948-43da-aed9-8052d0b0552d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037328 May 27 19:55:50.311650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 445/828] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:55:50.518327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-8ff4ceb1-abef-4e03-ab94-481ae52a47c2 req-29e89a0e-79d5-454b-82a7-f7b4316e6745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:50.528366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-8ff4ceb1-abef-4e03-ab94-481ae52a47c2 req-29e89a0e-79d5-454b-82a7-f7b4316e6745 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:50.528720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-8ff4ceb1-abef-4e03-ab94-481ae52a47c2 req-29e89a0e-79d5-454b-82a7-f7b4316e6745 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:50.533362 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:50.541191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5379a2a0-8e54-4eb1-952e-d3d1e9690825 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.337698 May 27 19:55:50.541762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 384/829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:50 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:50.551154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-8ff4ceb1-abef-4e03-ab94-481ae52a47c2 req-29e89a0e-79d5-454b-82a7-f7b4316e6745 service nova] Creating event network-changed:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:55:50.556346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-8ff4ceb1-abef-4e03-ab94-481ae52a47c2 req-29e89a0e-79d5-454b-82a7-f7b4316e6745 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042260 May 27 19:55:50.556968 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 446/830] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:51.565480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:51.565866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:51.573137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:51.573586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:51.574360 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:51.574798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:51.844673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:51.853530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d3c72488-57bb-4755-adde-80d06ccb78a4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1365 microversion: 2.1 time: 0.298841 May 27 19:55:51.863270 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 385/831] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:51 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:52.872292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:52.873021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:52.875039 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:52.887330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:52.887330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:52.887330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:52.887330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:53.113724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:55:53.119611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-862abbee-e915-4dc9-bac9-3a5e4b1aae6a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1555 microversion: 2.1 time: 0.252067 May 27 19:55:53.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 447/832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:55:52 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:55:53.141101 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:53.141651 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:53.148658 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:53.149139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:53.153930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:53.153930 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:53.246210 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8665c3e6-2bc9-4768-8356-567b4189e009 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108992 May 27 19:55:53.246891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 386/833] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:55:53 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:54.820373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-4f896ab4-e45d-4d33-9b56-20a55a6ec317 req-0ef1bf8f-b7c3-46d5-be5b-d3fff7a72fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb04690-f1fd-4202-8dbf-792d9e5f2dec", "tag": "c5f16c13-944f-4c67-956e-bbc4da9c8011"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:55:54.829502 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-4f896ab4-e45d-4d33-9b56-20a55a6ec317 req-0ef1bf8f-b7c3-46d5-be5b-d3fff7a72fd1 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:54.830273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-4f896ab4-e45d-4d33-9b56-20a55a6ec317 req-0ef1bf8f-b7c3-46d5-be5b-d3fff7a72fd1 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:54.843500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-4f896ab4-e45d-4d33-9b56-20a55a6ec317 req-0ef1bf8f-b7c3-46d5-be5b-d3fff7a72fd1 service nova] Creating event network-changed:c5f16c13-944f-4c67-956e-bbc4da9c8011 for instance efb04690-f1fd-4202-8dbf-792d9e5f2dec on hv-cinder-83979 May 27 19:55:54.849316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-4f896ab4-e45d-4d33-9b56-20a55a6ec317 req-0ef1bf8f-b7c3-46d5-be5b-d3fff7a72fd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168361 May 27 19:55:54.849916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 448/834] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:55:58.340907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:55:58.341439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:55:58.347450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:58.347920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:58.348685 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:55:58.349156 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:55:58.371592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-60885227-8629-4f58-a8af-91fe24a91c9f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/ips" status: 200 len: 150 microversion: 2.20 time: 0.257567 May 27 19:55:58.372078 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 387/835] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 27 19:55:58 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/ips => generated 150 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 19:56:00.342012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:00.342636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:00.349886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:00.350338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:00.351107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:00.351547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:00.373895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lazy-loading 'flavor' on Instance uuid a561207b-06b1-416c-adaf-8d3330997252 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:00.848643 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bb0510cc-e384-4c9b-aeac-912da2ae005f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/action" status: 202 len: 0 microversion: 2.20 time: 0.511664 May 27 19:56:00.849476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 449/836] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 19:56:00 2022] POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 19:56:00.857553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:00.860504 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:00.865624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:00.866066 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:00.866825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:00.867256 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:00.996959 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:01.005540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:01.007060 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:01.008193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3a705bbb-543b-4af2-891d-9c1b8253d637 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.154497 May 27 19:56:01.008747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 388/837] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:00 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:02.027545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:02.028237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:02.034629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:02.035074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:02.035885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:02.036313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:02.164842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:02.172725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:02.174262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:02.175568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5fb4ec47-af24-4550-a324-adc90037dd62 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.152736 May 27 19:56:02.176123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 450/838] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:02 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:03.193722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:03.194323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:03.200704 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:03.201178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:03.201958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:03.202389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:03.335777 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:03.343901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:03.345481 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:03.347539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-94f3e4fd-8073-47f3-bc59-e059816fc10a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.156902 May 27 19:56:03.348117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 389/839] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:03 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:04.365962 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:04.366571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:04.373181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:04.373630 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:04.374393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:04.374844 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:04.509657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:04.518008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:04.519605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:04.520793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-acef51ee-b15f-4f9b-9236-e52709c521a8 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.158987 May 27 19:56:04.521387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 451/840] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:04 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:05.539218 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:05.539811 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:05.546247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:05.546686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:05.547435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:05.547864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:05.674585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:05.682437 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:05.683929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:05.685094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9ba99cf0-0b81-4323-8132-e4984ed9071e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.149775 May 27 19:56:05.685649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 390/841] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:05 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:06.703639 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:06.704238 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:06.711771 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:06.712211 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:06.713267 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:06.713696 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:06.839320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:06.847366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:06.850600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:06.850600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-67a6a93a-1988-486d-b3a4-b7315b4a5b2c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.150305 May 27 19:56:06.850600 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 452/842] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:06 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:07.868557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:07.869280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:07.875404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:07.875855 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:07.876622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:07.877770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:08.012478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:08.020579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:08.022097 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:08.023269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-522377e2-6973-453e-a8c3-1603ca9759c3 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.158664 May 27 19:56:08.023818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 391/843] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:07 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:09.041257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:09.041869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:09.048556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:09.049545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:09.050464 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:09.050928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:09.055021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:09.182707 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:09.191331 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:09.192851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:09.194046 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fbcd08de-8730-4269-856c-360b35d6f96c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.156830 May 27 19:56:09.194611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 453/844] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:09 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:10.211836 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:10.212418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:10.219098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:10.219538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:10.220289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:10.220720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:10.349874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:10.353494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:10.358202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:10.359744 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:10.360895 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9080ffbc-c798-4b00-a167-de3c93e763f9 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.152973 May 27 19:56:10.365352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 392/845] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:10 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:11.380210 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:11.380819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:11.387537 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:11.387988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:11.388755 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:11.389220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:11.513748 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:11.522361 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:11.523878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:11.525072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f695081e-21c5-4884-932a-19a8ee5aafb6 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.149517 May 27 19:56:11.525627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 454/846] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:11 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:12.543567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:12.544162 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:12.551974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:12.552411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:12.553193 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:12.553625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:12.680630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:12.688451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:12.690600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:12.691653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-32a3fa50-cd79-46f5-92c9-584c1c683395 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.151982 May 27 19:56:12.692206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 393/847] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:12 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:13.709817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:13.710422 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:13.717171 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:13.717617 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:13.718368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:13.718798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:13.856791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:13.865562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:13.867048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:13.868389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f2721221-a702-48f3-9e2c-a25176729eae tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.162439 May 27 19:56:13.868970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 455/848] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:13 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:14.886398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:14.886953 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:14.894234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:14.894685 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:14.895446 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:14.895957 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:15.025613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:15.033471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:15.035190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:15.036334 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0181607f-dfe0-44a2-8e66-5b1bdbc6dbef tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.153896 May 27 19:56:15.036888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 394/849] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:14 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:16.055322 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:16.055924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:16.062413 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:16.062860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:16.063617 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:16.064051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:16.199300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:16.207441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:16.213603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:16.213603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9fa1116b-5772-419d-878a-998de65f6afa tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.158697 May 27 19:56:16.213603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 456/850] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:16 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:17.230623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:17.231208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:17.233636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=30 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:17.238879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:17.239849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:17.240206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:17.240722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:17.372734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:17.382160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:17.383676 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:17.384833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b8532afc-199c-40c7-9709-09cf22aca73c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1742 microversion: 2.20 time: 0.158113 May 27 19:56:17.385437 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 395/851] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:17 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:18.403642 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:18.404254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:18.411759 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:18.412211 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:18.412998 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:18.413442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:18.552157 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:18.560360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:18.561914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:18.563094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b71e3242-9718-4a50-97cd-77ffc0aa59e2 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1742 microversion: 2.20 time: 0.163408 May 27 19:56:18.563665 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 457/852] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:18 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:19.583120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:19.583706 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:19.592798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:19.593277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:19.594056 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:19.594485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:19.735320 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:19.745138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:19.746902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:19.748119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6710d405-16db-4a36-bb97-be585c39ae72 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.169276 May 27 19:56:19.748671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 396/853] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:19 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:20.447985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-33b4e110-7828-4eef-8f15-116f63f9f954 req-44abf769-1e18-410e-814b-41c8243c4bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "name": "network-vif-plugged", "status": "completed", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:20.457868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-33b4e110-7828-4eef-8f15-116f63f9f954 req-44abf769-1e18-410e-814b-41c8243c4bb2 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:20.458687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-33b4e110-7828-4eef-8f15-116f63f9f954 req-44abf769-1e18-410e-814b-41c8243c4bb2 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:20.475597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-33b4e110-7828-4eef-8f15-116f63f9f954 req-44abf769-1e18-410e-814b-41c8243c4bb2 service nova] Creating event network-vif-plugged:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:56:20.482251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-33b4e110-7828-4eef-8f15-116f63f9f954 req-44abf769-1e18-410e-814b-41c8243c4bb2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107099 May 27 19:56:20.483461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 458/854] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:20.771897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:20.772686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:20.781799 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:20.784505 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:20.786156 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:20.786724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:20.814183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:20.815300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:20.825518 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:20.828645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:20.829935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:20.832647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:20.938133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'services' on Instance uuid 91fb7b5c-926e-46ee-b703-45ad20c41a26 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:20.953547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:20.964980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:20.967050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:20.968618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6d3914ae-e200-4c63-8bd2-059deaa5f3cc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.203277 May 27 19:56:20.969569 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 397/855] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:20 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:21.136615 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e0fc1c05-5df6-4aca-a04f-bac3b20ffd2e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments/6c2c2f3d-3254-4980-836b-4284e58d4c78" status: 202 len: 0 microversion: 2.1 time: 0.327186 May 27 19:56:21.137672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 459/856] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:56:20 2022] DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments/6c2c2f3d-3254-4980-836b-4284e58d4c78 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:56:21.146373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:21.147751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:21.156168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:21.156693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:21.157415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:21.157889 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:21.194625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0ae29fac-58db-4c80-843f-803d8765b92f tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052211 May 27 19:56:21.195191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 398/857] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:21 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:21.988612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:21.989351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:21.996064 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:21.996517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:21.997528 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:21.997960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:22.145855 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:22.154275 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:22.155744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:22.156920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-717a6478-2341-4ba1-9605-800737359bf4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.173967 May 27 19:56:22.157544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 460/858] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:21 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:22.206733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:22.218201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:22.218201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:22.218201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:22.218201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:22.218573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:22.263782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c7bfa528-d587-4076-b01b-5471617e55e6 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061635 May 27 19:56:22.273668 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 399/859] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:22 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:23.175446 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:23.176180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:23.178678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=28 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:23.192858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.193348 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.194220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.194867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.278611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:23.279638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:23.296581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.303673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.305048 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.305597 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.353414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-44eecb0b-1fc4-45f1-bc4a-42f8b1482606 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078856 May 27 19:56:23.354205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 400/860] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:23 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 19:56:23.372744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:23.385824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:23.388130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:23.390141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9564e1f0-96d4-47d0-b618-5b6bdbf5f6b4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.218396 May 27 19:56:23.390902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 461/861] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:23 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:23.445854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:23.446879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:23.453572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.454393 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.455595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.456029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.483339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:56:23.820178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0b262c6a-3ed8-4996-a711-ecccd804be8e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 204 len: 0 microversion: 2.1 time: 0.377955 May 27 19:56:23.820825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 401/862] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:56:23 2022] DELETE /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 19:56:23.828870 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:23.830161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:23.839840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.840299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.841091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:23.841567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:23.996744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:24.005724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5acb6a08-84fd-435b-bf93-7cb7e116af22 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1689 microversion: 2.1 time: 0.180604 May 27 19:56:24.012642 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 462/863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:23 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:24.410184 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:24.411645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:24.418762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:24.419424 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:24.421205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:24.421673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:24.584686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:24.593216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:24.597340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:24.597340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b9d266a8-95ef-4dc8-bd54-73f42157467d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.192059 May 27 19:56:24.607691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 402/864] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:24 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:25.023667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:25.024276 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:25.030924 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:25.031383 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:25.032237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:25.033385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:25.176482 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:25.184577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-7c9fd874-db02-427e-afaa-3bb01899f2ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1689 microversion: 2.1 time: 0.164771 May 27 19:56:25.185207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 463/865] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:25 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:25.615737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:25.622489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:25.623013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:25.623462 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:25.624223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:25.624657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:25.761977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:25.772940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:25.774467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:25.775781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-67807062-7f04-4151-baea-2e00adcce4c1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.164523 May 27 19:56:25.778550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 403/866] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:25 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:26.202406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:26.203787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:26.211514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:26.212608 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:26.213764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:26.214289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:26.365547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:26.373735 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8ea61cf8-3879-4500-b961-38768bea0bf2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1689 microversion: 2.1 time: 0.175156 May 27 19:56:26.374310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 464/867] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:26 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:26.799299 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:26.800042 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:26.806729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:26.807188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:26.807965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:26.808404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:26.952728 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:26.963328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:26.963328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:26.964576 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e3fb5ca3-37f1-4f2b-9e74-d3659ebb5235 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.171520 May 27 19:56:26.968094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 404/868] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:26 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:27.391109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:27.392628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:27.402349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:27.403054 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:27.404129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:27.404970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:27.562018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:27.573087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f87eccbc-b2a5-474d-bdfa-0ad4dc40698c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1689 microversion: 2.1 time: 0.185811 May 27 19:56:27.573886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 465/869] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:27 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:27.988572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:27.990963 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:28.009809 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:28.013355 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:28.014224 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:28.014672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:28.311364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:28.324265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:28.326089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:28.327627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-923c75ee-746c-42bd-b0a5-6a986d037d67 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.347346 May 27 19:56:28.329709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 405/870] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:27 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:28.574660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-8921e73c-d366-4514-a56d-6ec283297f95 req-630edb2d-ed73-49a1-841d-8f410d462620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fb7b5c-926e-46ee-b703-45ad20c41a26", "name": "network-vif-deleted", "tag": "6c7d2c1c-c168-4f2c-aa88-17ed92dca977"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:28.584679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-8921e73c-d366-4514-a56d-6ec283297f95 req-630edb2d-ed73-49a1-841d-8f410d462620 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:28.585826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-8921e73c-d366-4514-a56d-6ec283297f95 req-630edb2d-ed73-49a1-841d-8f410d462620 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:28.591905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:28.592509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:28.601725 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-8921e73c-d366-4514-a56d-6ec283297f95 req-630edb2d-ed73-49a1-841d-8f410d462620 service nova] Creating event network-vif-deleted:6c7d2c1c-c168-4f2c-aa88-17ed92dca977 for instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 on hv-cinder-83979 May 27 19:56:28.604373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-8921e73c-d366-4514-a56d-6ec283297f95 req-630edb2d-ed73-49a1-841d-8f410d462620 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107498 May 27 19:56:28.605720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 466/871] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:28.610192 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:28.612443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:28.617789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:28.618448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:28.689503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:28.698586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1e9aa27b-2289-4376-af88-c1e79e88abd9 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 200 len: 1622 microversion: 2.1 time: 0.111587 May 27 19:56:28.709496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 406/872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:28 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 1622 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:29.347488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:29.348560 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:29.355385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:29.355838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:29.356840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:29.357336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:29.532647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:29.543878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:29.545404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:29.547738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b69f5df5-914d-41ba-8139-24ebc1737068 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1737 microversion: 2.20 time: 0.203768 May 27 19:56:29.547738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 467/873] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:29 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:29.716408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:29.717017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: 91fb7b5c-926e-46ee-b703-45ad20c41a26] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:29.723641 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:29.724082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:29.724846 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:29.725300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:29.738548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] HTTP exception thrown: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Request method failure captured: May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 HTTP/1.1 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvN-7XXjSH7cWkPu1kJRy1a-_svyOKCeQu57zkfa_0KkJ9ATvvYtFztWlGhENwRPv5g1Z8IyfwdHWfbFAtDcnGJZfU5N8fICy34QpfXtXZR83qv8i4QDM3or5ds5dfkISvzGf06rPDDL07QqGHU1PUNUHQz9NOP2YfFxGgeRiIXldk May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:56:29.740175 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3388fd386824477385e3ad6baa4cae56", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3388fd386824477385e3ad6baa4cae56"}]}] May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a13d2c50c5204c859872e99bc45c6566 May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. May 27 19:56:29.741729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '91fb7b5c-926e-46ee-b703-45ad20c41a26'} May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:56:29.742631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. May 27 19:56:29.744139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:29.745530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Returning 404 to user: Instance 91fb7b5c-926e-46ee-b703-45ad20c41a26 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:56:29.745530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3c4af534-9aee-45ff-a1ab-3842542a1a9c tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26" status: 404 len: 111 microversion: 2.1 time: 0.029407 May 27 19:56:29.745530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 407/874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:29 2022] GET /compute/v2.1/servers/91fb7b5c-926e-46ee-b703-45ad20c41a26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:56:29.750368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d3153850-c8aa-437b-b410-ab5e4fdf4869 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '.version_select at 0x7fe1b4a37700>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:29.825681 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d3153850-c8aa-437b-b410-ab5e4fdf4869 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915482917" status: 202 len: 0 microversion: 2.1 time: 0.079059 May 27 19:56:29.826546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 468/875] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 19:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915482917 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:56:30.566090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:30.566686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:30.572655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:30.573204 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:30.573905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:30.574336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:30.593920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:30.774848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:30.775355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:30.782462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:30.785803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:30.785803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:30.785803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:30.809741 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b0458981-143a-4a2c-8152-465fc857ecf6 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/ips" status: 200 len: 150 microversion: 2.1 time: 0.048288 May 27 19:56:30.810337 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 469/876] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:56:30 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:31.031529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:31.040509 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:31.042153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:31.043391 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3861eb38-7bd8-489e-b85f-7fce10733eda tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1719 microversion: 2.20 time: 0.482090 May 27 19:56:31.044023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 408/877] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:30 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1719 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:32.062847 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:32.063311 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:32.073430 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:32.073883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:32.074659 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:32.075096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:32.206848 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:32.215108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:32.216627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:32.217837 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9d32e7eb-606c-44ce-8858-89e4463ece4d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1719 microversion: 2.20 time: 0.159439 May 27 19:56:32.221692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 470/878] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:32 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:32.357770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-8b87c4de-38bc-4f5e-b229-24b335e69a2f req-76da77f7-d597-4d8a-a919-cfd8424340de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "name": "network-vif-unplugged", "status": "completed", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:32.369085 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8b87c4de-38bc-4f5e-b229-24b335e69a2f req-76da77f7-d597-4d8a-a919-cfd8424340de service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:32.369523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8b87c4de-38bc-4f5e-b229-24b335e69a2f req-76da77f7-d597-4d8a-a919-cfd8424340de service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:32.381774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-8b87c4de-38bc-4f5e-b229-24b335e69a2f req-76da77f7-d597-4d8a-a919-cfd8424340de service nova] Creating event network-vif-unplugged:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:56:32.386850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-8b87c4de-38bc-4f5e-b229-24b335e69a2f req-76da77f7-d597-4d8a-a919-cfd8424340de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032914 May 27 19:56:32.387479 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 409/879] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:32.413475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ea2710c-f8d2-4573-96a8-efb419e1e276"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:32.414930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:32.420391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:32.420835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:32.421620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:32.422052 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:32.497717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:33.101437 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:33.102039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:33.108502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.117908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.117908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.117908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.135694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:56:33.394366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c41d0dc4-c7c1-41c1-8201-2825189eb307 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "POST /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.984529 May 27 19:56:33.394920 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 471/880] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:56:32 2022] POST /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:33.400291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:33.401002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:33.407256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.408605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.409406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.409840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.504452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e6aaa279-0cb0-4877-a207-24d0d8486632 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 204 len: 0 microversion: 2.1 time: 0.401622 May 27 19:56:33.508166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 410/881] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:56:33 2022] DELETE /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 19:56:33.513913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:33.514726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:33.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.521676 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.522426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.522864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.561617 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:33.570273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:33.572272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:33.573564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-837ffd7e-eef8-41c0-a97c-50544aae1948 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1722 microversion: 2.20 time: 0.177555 May 27 19:56:33.574129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 472/882] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:33 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:33.591572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bf122b2-1965-4a67-835e-74f6cd8edff1"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:33.592747 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:33.599636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.600084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.601102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:33.601524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:33.667665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:33.676589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-81730a80-92a5-4660-b4d2-6594279cbb31 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1508 microversion: 2.1 time: 0.166921 May 27 19:56:33.677277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 411/883] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:33 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:34.543999 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f820d593-881a-4741-b734-93aa7a823b92 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.956758 May 27 19:56:34.544658 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 473/884] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 27 19:56:33 2022] POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments => generated 188 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 19:56:34.660781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:34.661316 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:34.667816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:34.668303 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:34.669082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:34.669514 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:34.694453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:34.695095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:34.701959 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:34.702408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:34.703175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:34.703607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:34.835435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:34.843212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-81f2ab69-b5d5-4941-9ec1-c3d83ef7667a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1508 microversion: 2.1 time: 0.152549 May 27 19:56:34.843781 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 474/885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:34 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:35.246631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7db2dd9d-eb85-44c0-8c9e-fe2441d17963 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments/3bf122b2-1965-4a67-835e-74f6cd8edff1" status: 202 len: 0 microversion: 2.20 time: 0.590060 May 27 19:56:35.247228 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 412/886] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 27 19:56:34 2022] DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments/3bf122b2-1965-4a67-835e-74f6cd8edff1 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 19:56:35.304845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:35.305432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:35.311394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:35.311842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:35.312596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:35.313170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:35.659540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [8a1dbf44-7932-4bcf-a432-5cb7dd2d3349] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 19:56:35.861920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:35.862528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:35.869231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:35.869675 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:35.870446 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:35.870881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:36.087211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:36.095451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a1daa471-03b1-40ca-8f3b-85ee5b7c5b1a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1508 microversion: 2.1 time: 0.237651 May 27 19:56:36.096124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 413/887] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:35 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:36.372105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-87051739-afb9-4f18-b45d-80f1e6a7519a req-f11f0efc-2d90-44a4-9cbb-d5c504f674f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2834017-00c4-4b0f-a2c0-88834cf9e767", "name": "network-vif-deleted", "tag": "490504e7-47c9-436f-ae03-1488bb94a341"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:36.381181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-87051739-afb9-4f18-b45d-80f1e6a7519a req-f11f0efc-2d90-44a4-9cbb-d5c504f674f3 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:36.388568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-87051739-afb9-4f18-b45d-80f1e6a7519a req-f11f0efc-2d90-44a4-9cbb-d5c504f674f3 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:36.393818 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-87051739-afb9-4f18-b45d-80f1e6a7519a req-f11f0efc-2d90-44a4-9cbb-d5c504f674f3 service nova] Creating event network-vif-deleted:490504e7-47c9-436f-ae03-1488bb94a341 for instance d2834017-00c4-4b0f-a2c0-88834cf9e767 on hv-cinder-83979 May 27 19:56:36.398918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-87051739-afb9-4f18-b45d-80f1e6a7519a req-f11f0efc-2d90-44a4-9cbb-d5c504f674f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 May 27 19:56:36.402526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 414/888] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:56:36.666687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [8a1dbf44-7932-4bcf-a432-5cb7dd2d3349] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34194. May 27 19:56:36.670532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e97ea607-eba0-4374-8725-062f71384c9e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/action" status: 202 len: 0 microversion: 2.20 time: 1.369582 May 27 19:56:36.673739 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 475/889] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 19:56:35 2022] POST /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/action => generated 0 bytes in 1371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 19:56:36.681223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:36.682115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:36.691289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:36.691842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:36.692695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:36.693260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:36.845789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:36.853936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:36.855429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:36.856567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-49735078-ec4e-4092-8481-873eaf644960 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1670 microversion: 2.20 time: 0.180276 May 27 19:56:36.857137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 415/890] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:36 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:37.113567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:37.114172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:37.121524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:37.121970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:37.122738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:37.123168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:37.157189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:37.161569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:37.162315 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'fault' on Instance uuid d2834017-00c4-4b0f-a2c0-88834cf9e767 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:37.207233 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:37.215657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1333ac29-146a-44a8-9571-8fb7a80e4355 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 200 len: 1312 microversion: 2.1 time: 0.107119 May 27 19:56:37.216277 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 476/891] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:37 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:37.874210 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:37.874751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:37.881243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:37.881714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:37.888010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:37.888010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.012277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:38.020726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:38.022339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:38.023480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c87b44ed-b3cd-4d81-87c6-b8dd24bc03f5 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1672 microversion: 2.20 time: 0.153249 May 27 19:56:38.024041 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 416/892] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:37 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:38.239452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:38.240057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d2834017-00c4-4b0f-a2c0-88834cf9e767] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:38.246692 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.247139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.247894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.248320 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.262749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] HTTP exception thrown: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Request method failure captured: May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 HTTP/1.1 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSvN-7XXjSH7cWkPu1kJRy1a-_svyOKCeQu57zkfa_0KkJ9ATvvYtFztWlGhENwRPv5g1Z8IyfwdHWfbFAtDcnGJZfU5N8fICy34QpfXtXZR83qv8i4QDM3or5ds5dfkISvzGf06rPDDL07QqGHU1PUNUHQz9NOP2YfFxGgeRiIXldk May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:56:38.264388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3388fd386824477385e3ad6baa4cae56", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3388fd386824477385e3ad6baa4cae56"}]}] May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: a13d2c50c5204c859872e99bc45c6566 May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. May 27 19:56:38.265993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'd2834017-00c4-4b0f-a2c0-88834cf9e767'} May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:56:38.266956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. May 27 19:56:38.269352 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:38.271356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Returning 404 to user: Instance d2834017-00c4-4b0f-a2c0-88834cf9e767 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:56:38.271356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-84859d28-fb4b-43cb-8254-c101c9c38ee2 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767" status: 404 len: 111 microversion: 2.1 time: 0.030535 May 27 19:56:38.271356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 477/893] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:38 2022] GET /compute/v2.1/servers/d2834017-00c4-4b0f-a2c0-88834cf9e767 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:56:38.275165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:38.275678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:38.281702 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.282190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.282942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.283368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.309146 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:56:38.618963 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2bdee40c-afb0-43fb-9334-e730c3a13504 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 204 len: 0 microversion: 2.1 time: 0.347471 May 27 19:56:38.619673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 417/894] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:56:38 2022] DELETE /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:56:38.632930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:38.632930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:38.634934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.635378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.636155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:38.636570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:38.771742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:38.779207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-de4c5a84-2dc3-44ad-a207-50063f3f3312 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.155315 May 27 19:56:38.779774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 478/895] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:38 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:39.043502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:39.044119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:39.050955 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:39.051403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:39.052169 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:39.052604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:39.186295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:39.195169 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:39.196679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:39.197864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1632be56-e4d1-4dd3-b19f-f3c2d0dc24fc tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.158757 May 27 19:56:39.198415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 418/896] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:39 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:39.797136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:39.797749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:39.804668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:39.805162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:39.805928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:39.806365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:39.935483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:39.943100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e2fef679-9b16-413b-b5cd-3bab9ce8d300 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.149821 May 27 19:56:39.943662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 479/897] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:39 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:40.216235 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:40.216941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:40.224967 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:40.225413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:40.226167 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:40.226621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:40.510248 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:40.518726 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:40.520234 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:40.521441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0e53a45d-f017-4a28-98d7-9c6c72a6797d tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.309053 May 27 19:56:40.521995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 419/898] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:40 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:40.960908 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:40.961554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:40.968293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:40.968739 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:40.969525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:40.969961 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:41.100368 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:41.107786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6f8a0d5c-2dfb-414b-b56f-8704e42bff97 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.151380 May 27 19:56:41.108375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 480/899] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:40 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:41.539153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:41.541487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:41.546220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:41.546663 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:41.547422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:41.547879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:41.681578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:41.683860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:41.690129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:41.691710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:41.695929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-11c2fa13-d90f-4fb4-9083-cbbeee71a113 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.158134 May 27 19:56:41.695929 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 420/900] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:41 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:42.230849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:42.231463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:42.237709 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:42.238162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:42.239002 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:42.239466 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:42.487380 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:42.500570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3e85f4a0-bf49-459d-8862-bd8b9a4777c8 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1521 microversion: 2.1 time: 0.376820 May 27 19:56:42.500570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 481/901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:42 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:42.712851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:42.713640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:42.721573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:42.722274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:42.723640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:42.724604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:42.871644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1c408e86-44f7-4ef0-b9fa-df94f780081e req-e37e6827-51f0-4116-b816-cd192a22a396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d81fcd54-4eed-417b-bd06-11187de21f7d", "name": "network-vif-deleted", "tag": "8ec277e7-3677-43e5-ba4a-31b5be9f2cf4"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:42.886472 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1c408e86-44f7-4ef0-b9fa-df94f780081e req-e37e6827-51f0-4116-b816-cd192a22a396 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:42.886929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1c408e86-44f7-4ef0-b9fa-df94f780081e req-e37e6827-51f0-4116-b816-cd192a22a396 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:42.912533 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1c408e86-44f7-4ef0-b9fa-df94f780081e req-e37e6827-51f0-4116-b816-cd192a22a396 service nova] Creating event network-vif-deleted:8ec277e7-3677-43e5-ba4a-31b5be9f2cf4 for instance d81fcd54-4eed-417b-bd06-11187de21f7d on hv-cinder-83979 May 27 19:56:42.927248 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1c408e86-44f7-4ef0-b9fa-df94f780081e req-e37e6827-51f0-4116-b816-cd192a22a396 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062400 May 27 19:56:42.929796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 482/902] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:56:42.995691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:43.006267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:43.008326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:43.009883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3271038c-8bc1-42f1-ac9c-7e7f7ff89b39 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.302342 May 27 19:56:43.017459 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 421/903] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:42 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:43.258832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:43.259564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:43.268439 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.268891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.269702 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.270448 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.415928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'services' on Instance uuid efb04690-f1fd-4202-8dbf-792d9e5f2dec {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:43.515200 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:43.516017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:43.522413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.523113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.524104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.524716 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.557916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:43.610062 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:43.619154 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bfc3ac57-9648-4bdd-9008-47ce4371ece4 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.107726 May 27 19:56:43.619965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 422/904] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:43 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:43.648648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bac1939e-078e-41ef-84ce-fc2d7e64419d tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments/5ea2710c-f8d2-4573-96a8-efb419e1e276" status: 202 len: 0 microversion: 2.1 time: 0.396484 May 27 19:56:43.649274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 483/905] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:56:43 2022] DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments/5ea2710c-f8d2-4573-96a8-efb419e1e276 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:56:43.658119 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:43.659116 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:43.666649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.667403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.668426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:43.669086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:43.701567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1893444e-01ed-4942-94cf-0cb93c2214cb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047695 May 27 19:56:43.702334 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 423/906] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:43 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:44.042397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:44.043404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:44.050378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.051166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.053126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.053818 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.206910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:44.215644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:44.217255 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:44.218458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c54752af-5c4a-4cca-bad2-78b1dd05a656 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.181322 May 27 19:56:44.219020 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 484/907] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:44 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:44.637470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:44.638745 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:44.646915 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.647568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.648534 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.649258 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.714350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:44.716084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:44.724376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.725123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.725280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:44.726051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:44.726582 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:44.732727 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f71ee16a-2bc2-4de8-a66d-1497c0c04625 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.100580 May 27 19:56:44.733311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 424/908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:44 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:44.760078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e4be30ba-53b0-40f7-8c9c-7e4bed244980 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049878 May 27 19:56:44.761012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 485/909] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:44 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:45.236469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:45.237198 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:45.244144 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.244670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.245538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.246023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.386725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:45.394688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:45.396363 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:45.397562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-60c99ead-d89b-43f0-93df-dc88fab903f4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.165291 May 27 19:56:45.398457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 425/910] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:45 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:45.750603 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:45.751215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:45.758041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.758491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.759266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.759709 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.772879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:45.773827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:45.782088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.784660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.786625 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:45.787089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:45.819280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a5ed6fdf-490d-4a1a-b1bf-ffc44b4782f3 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051271 May 27 19:56:45.819998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 426/911] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:45 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:45.834625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:45.843136 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4f1c817d-5c33-4282-b99d-2d2ab5898d19 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.096328 May 27 19:56:45.843712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 486/912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:45 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:46.416414 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:46.417103 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:46.425860 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.426891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.428254 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.428732 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.594804 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:46.608656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:46.610552 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:46.612097 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-885642ca-0e6c-4b07-b786-586f045e3ed1 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.199586 May 27 19:56:46.612897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 427/913] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:46 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:46.831882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:46.833734 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:46.841133 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.841633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.842534 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.842970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.859702 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:46.860622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:46.871776 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.872233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.873141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:46.873576 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:46.885393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a1202625-aafe-4b34-a813-e1215706b483 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057550 May 27 19:56:46.886159 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 487/914] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:46 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:46.951339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:46.964800 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-60500b94-2cfc-4ed6-bfcb-0099c3616e6a tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.108873 May 27 19:56:46.965461 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 428/915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:46 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:47.633634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:47.634274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:47.640658 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.641164 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:47.641946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.642385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:47.787507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:47.796645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:47.798648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:47.800909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ec1d3f23-6b8e-43e4-8366-aec480b603e7 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.171810 May 27 19:56:47.801968 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 488/916] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:47 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:47.898267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:47.899359 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:47.901720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:47.907653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.925202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:47.925202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.925202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:47.940185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f414a5c9-408c-4f41-b127-bdece58ea170 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 May 27 19:56:47.940780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 429/917] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:47 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:47.982412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:47.982982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:47.990305 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.990751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:47.991645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:47.992090 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:48.067923 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:48.082148 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-36211af6-c7d1-4d87-9f1b-df1a22a514a3 tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.103542 May 27 19:56:48.083538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 489/918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:47 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:48.827190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:48.827823 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:48.839778 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:48.840229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:48.841030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:48.841466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:48.956704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:48.958812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:48.971124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:48.971567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:48.972336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:48.972771 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:48.993553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:48.996632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:48.998226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:48.999460 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5631598a-82b7-44e5-94fc-fb2571a28986 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.176346 May 27 19:56:49.012502 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-23882f62-93b1-41b0-bc6d-10d659d81b28 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063802 May 27 19:56:49.016301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 430/919] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:48 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:49.021171 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 490/920] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:48 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:56:49.101982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:49.102684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:49.109319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:49.109807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:49.110560 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:49.111061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:49.180269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:49.187906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ea55d47f-b9a8-48cc-9266-09f78a8c549e tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.090867 May 27 19:56:49.188482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 431/921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:49 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:50.020316 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:50.021866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:50.024275 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:50.025792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:50.029264 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.029722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.030656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.031096 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.033404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.034029 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.035074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.035618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.095507 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0d603a9f-7977-4825-9001-c9aa8584ad96 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075327 May 27 19:56:50.098939 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 432/922] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:50 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:50.207583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:50.207583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:50.211147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:50.219483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.220231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.221376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:50.221578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:50.222139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:50.223062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:50.225054 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f7e2ae12-efe6-4f94-86ab-f8093cba9905 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.208832 May 27 19:56:50.228776 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 491/923] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:50 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:50.291833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:50.299904 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-40ed661d-1243-463a-8c17-527f9696cc8b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1307 microversion: 2.1 time: 0.097989 May 27 19:56:50.300472 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 433/924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:50 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:51.108723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:51.109690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:51.116142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.116584 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.117382 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.117815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.146824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2b13bf7b-8c06-4d13-aaa9-d6007a3d1659 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042074 May 27 19:56:51.147375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 492/925] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:51 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:51.244019 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:51.244646 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:51.251103 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.251545 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.252298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.252735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.318662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:51.319293 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:51.325341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.325794 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.326557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.326992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.357986 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:51.358434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:51.358934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'fault' on Instance uuid d81fcd54-4eed-417b-bd06-11187de21f7d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:51.387832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:51.396054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:51.397637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:51.398800 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5a8c2cf3-fa36-46e1-b3c4-bb4520b36a64 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.159647 May 27 19:56:51.399357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 434/926] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:51 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:51.403314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:51.410871 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-caca25f9-b849-4305-97a4-325cbea6986b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1312 microversion: 2.1 time: 0.096913 May 27 19:56:51.417278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 493/927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:51 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:52.158176 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:52.159087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:52.165729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.166173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.166925 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.167353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.195212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-24253506-d966-4a74-8632-b8dad34e38c0 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 May 27 19:56:52.195753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 435/928] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:52 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:52.417700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:52.418312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:52.424896 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.425415 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.426473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.426922 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.431586 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:52.432189 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:52.438457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.438902 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.439660 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.440088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.476070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:52.476539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:52.477015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lazy-loading 'fault' on Instance uuid d81fcd54-4eed-417b-bd06-11187de21f7d {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:52.531173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a13d2c50c5204c859872e99bc45c6566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3388fd386824477385e3ad6baa4cae56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:52.540342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a1282f68-15cc-44f6-8644-66548fc317ea tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 200 len: 1312 microversion: 2.1 time: 0.112516 May 27 19:56:52.541087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 436/929] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:52 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:52.562645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:52.570832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:52.572746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:52.573535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-225e83c2-6275-48e4-a6d3-49caf1cc5766 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.159781 May 27 19:56:52.574095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 494/930] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:52 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:53.206763 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:53.207714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:53.214627 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.215070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.215821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.216251 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.218585 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=100 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:53.244994 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-86f1a457-df94-4968-a625-9160edbc74b1 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042159 May 27 19:56:53.245543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 437/931] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 19:56:53 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 19:56:53.303174 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:53.303668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:53.305672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:53.310410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.310858 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.311622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.312062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.338626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:56:53.558539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:53.559201 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] [instance: d81fcd54-4eed-417b-bd06-11187de21f7d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:53.560712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-498cc461-f865-45a6-b705-26caacc823da tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 204 len: 0 microversion: 2.1 time: 0.261180 May 27 19:56:53.561339 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 495/932] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:56:53 2022] DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:56:53.567050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.572225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.572225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.572225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.572538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:53.572538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:53.577955 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.578544 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.579377 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.579844 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.583669 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] HTTP exception thrown: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Request method failure captured: May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d HTTP/1.1 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSvN-7XXjSH7cWkPu1kJRy1a-_svyOKCeQu57zkfa_0KkJ9ATvvYtFztWlGhENwRPv5g1Z8IyfwdHWfbFAtDcnGJZfU5N8fICy34QpfXtXZR83qv8i4QDM3or5ds5dfkISvzGf06rPDDL07QqGHU1PUNUHQz9NOP2YfFxGgeRiIXldk May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:56:53.585358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3388fd386824477385e3ad6baa4cae56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3388fd386824477385e3ad6baa4cae56", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3388fd386824477385e3ad6baa4cae56"}]}] May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 3388fd386824477385e3ad6baa4cae56 May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-553248455 May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: a13d2c50c5204c859872e99bc45c6566 May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-ServerRescueNegativeTestJSON-553248455-project May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. May 27 19:56:53.587095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'd81fcd54-4eed-417b-bd06-11187de21f7d'} May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:56:53.587914 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. May 27 19:56:53.589261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:56:53.590482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] Returning 404 to user: Instance d81fcd54-4eed-417b-bd06-11187de21f7d could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:56:53.590482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2d085682-4c03-4e81-90d9-a58cf34edd5b tempest-ServerRescueNegativeTestJSON-553248455 tempest-ServerRescueNegativeTestJSON-553248455-project] 10.222.0.13 "GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d" status: 404 len: 111 microversion: 2.1 time: 0.033074 May 27 19:56:53.590482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 438/933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:53 2022] GET /compute/v2.1/servers/d81fcd54-4eed-417b-bd06-11187de21f7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 19:56:53.592262 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:53.592872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:53.599423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.599870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.600665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:53.601094 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:53.731891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:53.736397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fd1c4268-ab92-4202-b436-2de9db8462ab tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1680 microversion: 2.1 time: 0.170713 May 27 19:56:53.737366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 496/934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:53 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:53.751203 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:53.759645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:53.761169 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:53.762379 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d8df427c-e046-483d-b40a-b41b95fa93ac tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.173713 May 27 19:56:53.762867 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 439/935] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:53 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:54.754637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:54.755721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:54.762835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:54.763292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:54.764070 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:54.764504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:54.780496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:54.781740 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:54.789508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:54.789968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:54.790738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:54.791382 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:54.934214 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:54.949033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:54.950543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:54.951712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4a5c5a62-2c17-4af2-9b0b-adef2b7228e4 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.175096 May 27 19:56:54.952255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 440/936] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:54 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 19:56:54.997907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:55.006565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d27d1ef9-8433-4f10-b124-afa0ad444833 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1680 microversion: 2.1 time: 0.255955 May 27 19:56:55.007376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 497/937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:54 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:55.971084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:55.971698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:55.979505 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:55.979971 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:55.980755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:55.981297 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:56.027672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:56.028976 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:56.038362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:56.039101 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:56.040470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:56.041406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:56.066490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:56.160317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:56.181943 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-13fe5309-60dd-4e78-b025-e2523209451e tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1613 microversion: 2.1 time: 0.161733 May 27 19:56:56.188493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 498/938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:56 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1613 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:56:56.270817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:56.280760 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:56.282403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:56.283576 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d7c96241-a4a1-42fb-aa43-bd6d070b4536 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.316429 May 27 19:56:56.290508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 441/939] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:55 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:56.424757 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-df869918-eec9-4658-9544-03c74d8e4b32 req-9123bc8b-8f33-4247-9087-dfe6944f75fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb04690-f1fd-4202-8dbf-792d9e5f2dec", "name": "network-vif-deleted", "tag": "c5f16c13-944f-4c67-956e-bbc4da9c8011"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:56.434263 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-df869918-eec9-4658-9544-03c74d8e4b32 req-9123bc8b-8f33-4247-9087-dfe6944f75fa service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:56.434978 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-df869918-eec9-4658-9544-03c74d8e4b32 req-9123bc8b-8f33-4247-9087-dfe6944f75fa service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:56.451326 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-df869918-eec9-4658-9544-03c74d8e4b32 req-9123bc8b-8f33-4247-9087-dfe6944f75fa service nova] Creating event network-vif-deleted:c5f16c13-944f-4c67-956e-bbc4da9c8011 for instance efb04690-f1fd-4202-8dbf-792d9e5f2dec on hv-cinder-83979 May 27 19:56:56.458817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-df869918-eec9-4658-9544-03c74d8e4b32 req-9123bc8b-8f33-4247-9087-dfe6944f75fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038703 May 27 19:56:56.459436 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 499/940] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:56.566673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-0e12bc4d-2073-4173-ade9-b979f52629d0 req-a97f7378-aab9-4c95-bab4-252d5d8b4700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "name": "network-vif-plugged", "status": "completed", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:56:56.584223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0e12bc4d-2073-4173-ade9-b979f52629d0 req-a97f7378-aab9-4c95-bab4-252d5d8b4700 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:56.585225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0e12bc4d-2073-4173-ade9-b979f52629d0 req-a97f7378-aab9-4c95-bab4-252d5d8b4700 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:56.629755 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-0e12bc4d-2073-4173-ade9-b979f52629d0 req-a97f7378-aab9-4c95-bab4-252d5d8b4700 service nova] Creating event network-vif-plugged:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:56:56.639894 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-0e12bc4d-2073-4173-ade9-b979f52629d0 req-a97f7378-aab9-4c95-bab4-252d5d8b4700 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080098 May 27 19:56:56.644113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 442/941] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:56:57.199672 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:57.201243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:57.212343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:57.221638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:57.232417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:57.232417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:57.288306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:57.289067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:57.289953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lazy-loading 'fault' on Instance uuid efb04690-f1fd-4202-8dbf-792d9e5f2dec {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:56:57.314024 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:57.314732 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:57.325924 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:57.326374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:57.327199 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:57.327633 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:57.368161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c9aa6527c13466bbe5dce68a3b81ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c994c57a63464397bd567b97dbc3097e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:57.386376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-64204b84-7239-4787-b9e6-91f2b0ff86b4 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 200 len: 1330 microversion: 2.1 time: 0.191284 May 27 19:56:57.388091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 500/942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:57 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 1330 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:56:57.581813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:57.602903 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:57.605496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:57.607919 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-38677511-d163-4bcc-a841-80248bbce453 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.309450 May 27 19:56:57.609168 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 443/943] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:57 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:58.405465 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:58.411078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:58.412936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:58.413400 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:58.414163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:58.414590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:58.428656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec HTTP/1.1 May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:56:58.430353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:56:58.431983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'efb04690-f1fd-4202-8dbf-792d9e5f2dec'} May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:56:58.432942 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:56:58.440370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:56:58.441535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:56:58.441535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e2e63bf5-df13-4429-b965-b03117843740 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 404 len: 111 microversion: 2.1 time: 0.030177 May 27 19:56:58.441535 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 501/944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:56:58 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:56:58.441766 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e8cfcdb8-6dfa-4475-a5b1-12376b0d568c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '.version_select at 0x7fe1b4a2daf0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:58.510196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e8cfcdb8-6dfa-4475-a5b1-12376b0d568c tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-263872067" status: 202 len: 0 microversion: 2.1 time: 0.073179 May 27 19:56:58.510894 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 444/945] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 19:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-263872067 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:56:58.627219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:58.627951 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:58.634580 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:58.635210 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:58.636141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:58.636571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:58.802228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:58.811517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:58.813108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:58.815736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-26fecbd3-90e1-40de-8ea7-c635596fc867 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.191271 May 27 19:56:58.815736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 502/946] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:58 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:56:59.833639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:56:59.834206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:56:59.841691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:59.842249 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:59.848827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:56:59.848827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:56:59.983427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:59.992121 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:59.993673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:56:59.994832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-862a4430-c148-4fa4-8cc6-958eff48082e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1728 microversion: 2.20 time: 0.165860 May 27 19:56:59.995384 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 445/947] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:56:59 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:00.609564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:00.610082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:00.616811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:00.619006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:00.619006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:00.619006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:00.632289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec HTTP/1.1 May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:00.633880 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.635410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'efb04690-f1fd-4202-8dbf-792d9e5f2dec'} May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:00.636328 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.638102 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:00.639645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:00.639645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ca8bca9c-5af4-463b-a6b8-66feb3387dcb tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 404 len: 111 microversion: 2.1 time: 0.029520 May 27 19:57:00.639645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 503/948] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:57:00 2022] DELETE /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:00.646452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:00.647074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: efb04690-f1fd-4202-8dbf-792d9e5f2dec] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:00.653180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:00.653630 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:00.654397 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:00.654881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:00.668649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec HTTP/1.1 May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:00.670311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.671961 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'efb04690-f1fd-4202-8dbf-792d9e5f2dec'} May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:00.673518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. May 27 19:57:00.675487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:00.677141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance efb04690-f1fd-4202-8dbf-792d9e5f2dec could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:00.677141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-32d3543c-5f05-4052-891f-37b89c941161 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec" status: 404 len: 111 microversion: 2.1 time: 0.030384 May 27 19:57:00.677141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 446/949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:00 2022] GET /compute/v2.1/servers/efb04690-f1fd-4202-8dbf-792d9e5f2dec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:01.012656 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:01.013290 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:01.019333 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:01.019780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:01.021201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:01.021828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:01.154019 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:01.162881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:01.164434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:01.167438 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-67496cb9-772b-4205-817f-fed4a785e587 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1715 microversion: 2.20 time: 0.156792 May 27 19:57:01.168171 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 504/950] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:01 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:01.964187 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:01.964817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:01.971820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:01.972269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:01.973055 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:01.973666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:01.987127 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 HTTP/1.1 May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:01.993840 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:01.995423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '103930b7-69c6-42cc-89de-8f69b48c79d8'} May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:01.996259 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:01.997708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:01.999171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:01.999171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ae3af219-1bf0-42d9-97d2-bdce076b67be tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 404 len: 111 microversion: 2.1 time: 0.031292 May 27 19:57:01.999171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 447/951] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:57:01 2022] DELETE /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:02.000342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:02.000974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 103930b7-69c6-42cc-89de-8f69b48c79d8] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:02.008123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.008569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.009355 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.010012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.023180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 HTTP/1.1 May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:02.024695 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:02.031037 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '103930b7-69c6-42cc-89de-8f69b48c79d8'} May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:02.031796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. May 27 19:57:02.033202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.034334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 103930b7-69c6-42cc-89de-8f69b48c79d8 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:02.034334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a049c81f-d98b-487a-bd27-09f3f99a130a tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8" status: 404 len: 111 microversion: 2.1 time: 0.029553 May 27 19:57:02.034334 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 505/952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:01 2022] GET /compute/v2.1/servers/103930b7-69c6-42cc-89de-8f69b48c79d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 19:57:02.034555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:02.034909 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:02.041225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.041671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.042434 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.042868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.056738 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f HTTP/1.1 May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:02.058313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.060051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '87a8e8f6-08f1-4ac5-beae-03501818ff8f'} May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:02.060821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.062102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:02.063377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:02.063377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8af8b394-d2df-4e50-bad4-3055045eda92 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 404 len: 111 microversion: 2.1 time: 0.029039 May 27 19:57:02.063377 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 448/953] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:57:02 2022] DELETE /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:02.069330 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:02.069932 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 87a8e8f6-08f1-4ac5-beae-03501818ff8f] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:02.076317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.076786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.077749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:02.078195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:02.092899 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f HTTP/1.1 May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:02.094784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.096179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '87a8e8f6-08f1-4ac5-beae-03501818ff8f'} May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:02.097041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. May 27 19:57:02.099503 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:02.101309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 87a8e8f6-08f1-4ac5-beae-03501818ff8f could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:02.101309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-702edaa6-6422-4f42-b239-9abdbe5750ff tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f" status: 404 len: 111 microversion: 2.1 time: 0.031933 May 27 19:57:02.101309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 506/954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:02 2022] GET /compute/v2.1/servers/87a8e8f6-08f1-4ac5-beae-03501818ff8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:03.385789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:03.386300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:03.392839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:03.393314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:03.394087 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:03.394527 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:03.408476 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d HTTP/1.1 May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:03.410030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.412223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '2c6870d2-0e10-4d9d-b00a-35b77afceb0d'} May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:03.413054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.414358 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:03.415821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:03.415821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dab9b7ab-4017-48a4-89b5-f936ab045b60 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 404 len: 111 microversion: 2.1 time: 0.030152 May 27 19:57:03.415821 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 449/955] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:57:03 2022] DELETE /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:03.420992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:03.421605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] [instance: 2c6870d2-0e10-4d9d-b00a-35b77afceb0d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:03.428835 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:03.429311 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:03.430124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:03.430581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:03.446062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] HTTP exception thrown: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Request method failure captured: May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d HTTP/1.1 May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSuAV_xVEs2_3ffqwlUfFy7zep8dSpKGO_0izwGHAEQnVJc1FOgjwrhnFEBd_iNKJcE06DMqLNZ0La0HudU0QZhaLYM6GSX9Ghhb65BRVm9sQvW9wPnrEZRH65i7gB_LcFNu-QOQr-FzWUWHTGdD7f4aK2tTuq9JCC4qyuKXSb8whio May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:03.447570 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c994c57a63464397bd567b97dbc3097e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c994c57a63464397bd567b97dbc3097e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c994c57a63464397bd567b97dbc3097e"}]}] May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: c994c57a63464397bd567b97dbc3097e May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1866824069 May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 3c9aa6527c13466bbe5dce68a3b81ab5 May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeNegativeTest-1866824069-project May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.449236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '2c6870d2-0e10-4d9d-b00a-35b77afceb0d'} May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:03.450147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. May 27 19:57:03.451712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:03.453168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] Returning 404 to user: Instance 2c6870d2-0e10-4d9d-b00a-35b77afceb0d could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:03.453168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-432b2c1c-29c6-4a35-8ae0-c47c441427e5 tempest-AttachVolumeNegativeTest-1866824069 tempest-AttachVolumeNegativeTest-1866824069-project] 10.222.0.13 "GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d" status: 404 len: 111 microversion: 2.1 time: 0.031765 May 27 19:57:03.453168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 507/956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:03 2022] GET /compute/v2.1/servers/2c6870d2-0e10-4d9d-b00a-35b77afceb0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:09.253956 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-800c562c-c5c5-4b4f-92ac-83b4a60e87c7 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Action: 'create', calling method: .version_select at 0x7fe1b4818b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2045752377"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:09.883626 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-800c562c-c5c5-4b4f-92ac-83b4a60e87c7 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.745495 May 27 19:57:09.884274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 450/957] 10.222.0.13 () {60 vars in 1154 bytes} [Fri May 27 19:57:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 747 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 19:57:09.895475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2a368ca5-d0f4-44b5-a090-6de93408c948 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b5c94b80>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:09.944335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2a368ca5-d0f4-44b5-a090-6de93408c948 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 200 len: 345 microversion: 2.1 time: 0.052837 May 27 19:57:09.944899 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 508/958] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:57:09 2022] GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:10.957386 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d1ecdc5c-2cd5-47c6-a16e-c14f1f58f1ec tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48b5af0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:11.007558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d1ecdc5c-2cd5-47c6-a16e-c14f1f58f1ec tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 200 len: 346 microversion: 2.1 time: 0.054465 May 27 19:57:11.008236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 451/959] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:57:10 2022] GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:11.020274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f738260e-5044-4f40-b754-1ed99e4a5a63 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Action: 'create', calling method: .version_select at 0x7fe1b5cbe790>, body: {"snapshot": {"volume_id": "f44ae9f8-40e6-4dae-b140-13a8d5cf7885", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-950703405"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:11.418930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f738260e-5044-4f40-b754-1ed99e4a5a63 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.403262 May 27 19:57:11.419602 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 509/960] 10.222.0.13 () {60 vars in 1161 bytes} [Fri May 27 19:57:11 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:57:11.429542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-020b4be3-c3fa-403a-88d1-b048a9776b3f tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48a0ca0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:11.459161 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-020b4be3-c3fa-403a-88d1-b048a9776b3f tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 286 microversion: 2.1 time: 0.033593 May 27 19:57:11.459780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 452/961] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:11 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:11.469524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-90f7d837-39f1-42c3-9a3c-b8a6b844030e tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b49a7a60>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:11.500253 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-90f7d837-39f1-42c3-9a3c-b8a6b844030e tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034432 May 27 19:57:11.500910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 510/962] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 19:57:11 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:11.512078 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-eb4b92ce-3684-46e4-b45f-2b9169c4c346 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4710c10>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:11.543142 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-eb4b92ce-3684-46e4-b45f-2b9169c4c346 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 286 microversion: 2.1 time: 0.035217 May 27 19:57:11.543705 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 453/963] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:11 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:12.555163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e5b38e01-4cb7-43be-b884-a6ce1b0dd55a tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b46d89d0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:12.586196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e5b38e01-4cb7-43be-b884-a6ce1b0dd55a tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 286 microversion: 2.1 time: 0.035233 May 27 19:57:12.586753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 511/964] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:12 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:13.595113 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:13.595862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=47 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:13.600211 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b7ce6ffe-062b-448a-a83b-1d08781e4656 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48ca160>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:13.629559 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b7ce6ffe-062b-448a-a83b-1d08781e4656 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 286 microversion: 2.1 time: 0.035472 May 27 19:57:13.630107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 454/965] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:13 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:14.637881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:14.638762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=34 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:14.643055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fe2f346-036f-4616-931e-9d5ab049082b tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4a1cdc0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:14.673195 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5fe2f346-036f-4616-931e-9d5ab049082b tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 287 microversion: 2.1 time: 0.036006 May 27 19:57:14.673772 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 512/966] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:14 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:14.685649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-92149972-458b-426b-a0a9-bbb9a9081546 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48a01f0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:14.823719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-92149972-458b-426b-a0a9-bbb9a9081546 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 202 len: 0 microversion: 2.1 time: 0.142515 May 27 19:57:14.825138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 455/967] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 27 19:57:14 2022] DELETE /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:57:14.839468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3998d5d3-2166-4763-a9ac-2801a7a64a79 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4b77160>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:14.870831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3998d5d3-2166-4763-a9ac-2801a7a64a79 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 200 len: 286 microversion: 2.1 time: 0.036115 May 27 19:57:14.871481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 513/968] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:14 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:15.883538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-19cbe55a-0b84-441f-b8ca-a5fdfde13b22 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48b58b0>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:15.911145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-19cbe55a-0b84-441f-b8ca-a5fdfde13b22 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] HTTP exception thrown: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-19cbe55a-0b84-441f-b8ca-a5fdfde13b22 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Request method failure captured: May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb HTTP/1.1 May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS0V_EF__RjLWdjhIwe_waxqjVFTud3pmU0MoAiNp9RzSQvZL4FC3ux8GgLYfDPOz4TbSJ7P0xchnmXwDgMyruoeWrFJxp0O056B-pmUSsXlFk-8eS7xwdD15OOKCcIwXJRnJ6yoUO2A3ka0Kr8RgyvxxBH5tUyGgfDK6w5QbND--bM May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:15.913444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_517b8862a76443f09cbee095c54cd4ea", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/517b8862a76443f09cbee095c54cd4ea"}]}] May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: d8c613270c654a21aba84643f4844756 May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '87cd9eee-72ef-40bb-b551-28aeed1928cb'} May 27 19:57:15.920912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. (HTTP 404) (Request-ID: req-e5ec1568-ae42-4749-ae8d-96e6e0276574) May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.921965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:15.923376 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 19:57:15.924781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-19cbe55a-0b84-441f-b8ca-a5fdfde13b22 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Returning 404 to user: Snapshot 87cd9eee-72ef-40bb-b551-28aeed1928cb could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:15.927372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-19cbe55a-0b84-441f-b8ca-a5fdfde13b22 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb" status: 404 len: 111 microversion: 2.1 time: 0.036059 May 27 19:57:15.928484 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 456/969] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:57:15 2022] GET /compute/v2.1/os-snapshots/87cd9eee-72ef-40bb-b551-28aeed1928cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 19:57:15.928575 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-53b3cf9d-0961-4033-9d0b-cd06f5419a6f tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4a1cf70>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:16.090849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-53b3cf9d-0961-4033-9d0b-cd06f5419a6f tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 202 len: 0 microversion: 2.1 time: 0.171166 May 27 19:57:16.091526 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 514/970] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:57:15 2022] DELETE /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:57:16.101183 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d2c57b17-e4f8-434f-b971-f023a3082b43 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48b5700>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:16.154455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d2c57b17-e4f8-434f-b971-f023a3082b43 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 200 len: 345 microversion: 2.1 time: 0.055315 May 27 19:57:16.154455 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 457/971] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:57:16 2022] GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:17.165061 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4aaece3e-1053-4c25-8130-1d64ca886259 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4b77280>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:17.192558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-4aaece3e-1053-4c25-8130-1d64ca886259 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] HTTP exception thrown: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4aaece3e-1053-4c25-8130-1d64ca886259 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Request method failure captured: May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 HTTP/1.1 May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS0V_EF__RjLWdjhIwe_waxqjVFTud3pmU0MoAiNp9RzSQvZL4FC3ux8GgLYfDPOz4TbSJ7P0xchnmXwDgMyruoeWrFJxp0O056B-pmUSsXlFk-8eS7xwdD15OOKCcIwXJRnJ6yoUO2A3ka0Kr8RgyvxxBH5tUyGgfDK6w5QbND--bM May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:17.194529 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_517b8862a76443f09cbee095c54cd4ea", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/517b8862a76443f09cbee095c54cd4ea"}]}] May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: d8c613270c654a21aba84643f4844756 May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'f44ae9f8-40e6-4dae-b140-13a8d5cf7885'} May 27 19:57:17.196846 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. (HTTP 404) (Request-ID: req-2288713d-73b3-4586-9a8a-42a39bfaa48e) May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.197778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:17.198992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 19:57:17.200185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4aaece3e-1053-4c25-8130-1d64ca886259 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Returning 404 to user: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4aaece3e-1053-4c25-8130-1d64ca886259 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 404 len: 109 microversion: 2.1 time: 0.035397 May 27 19:57:17.201412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 515/972] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:57:17 2022] GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:17.211702 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-baa8b4ad-78f1-45ab-bca1-1632ce183c56 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b48a0a60>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:17.238463 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-baa8b4ad-78f1-45ab-bca1-1632ce183c56 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] HTTP exception thrown: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-baa8b4ad-78f1-45ab-bca1-1632ce183c56 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Request method failure captured: May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 HTTP/1.1 May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS0V_EF__RjLWdjhIwe_waxqjVFTud3pmU0MoAiNp9RzSQvZL4FC3ux8GgLYfDPOz4TbSJ7P0xchnmXwDgMyruoeWrFJxp0O056B-pmUSsXlFk-8eS7xwdD15OOKCcIwXJRnJ6yoUO2A3ka0Kr8RgyvxxBH5tUyGgfDK6w5QbND--bM May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:17.240582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_517b8862a76443f09cbee095c54cd4ea", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/517b8862a76443f09cbee095c54cd4ea"}]}] May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: d8c613270c654a21aba84643f4844756 May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'f44ae9f8-40e6-4dae-b140-13a8d5cf7885'} May 27 19:57:17.242266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. (HTTP 404) (Request-ID: req-7b5c9a2b-3bde-4c0a-a5d2-846e5402c341) May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.243304 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 19:57:17.244712 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 19:57:17.246250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-baa8b4ad-78f1-45ab-bca1-1632ce183c56 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Returning 404 to user: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-baa8b4ad-78f1-45ab-bca1-1632ce183c56 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 404 len: 109 microversion: 2.1 time: 0.035512 May 27 19:57:17.247637 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 458/973] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:57:17 2022] DELETE /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:17.251362 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fd24b6bc-fac4-40b1-be5e-5c206ea5bc14 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Calling method '.version_select at 0x7fe1b4697940>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:17.279261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-fd24b6bc-fac4-40b1-be5e-5c206ea5bc14 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] HTTP exception thrown: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fd24b6bc-fac4-40b1-be5e-5c206ea5bc14 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Request method failure captured: May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 HTTP/1.1 May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS0V_EF__RjLWdjhIwe_waxqjVFTud3pmU0MoAiNp9RzSQvZL4FC3ux8GgLYfDPOz4TbSJ7P0xchnmXwDgMyruoeWrFJxp0O056B-pmUSsXlFk-8eS7xwdD15OOKCcIwXJRnJ6yoUO2A3ka0Kr8RgyvxxBH5tUyGgfDK6w5QbND--bM May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:17.281252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/517b8862a76443f09cbee095c54cd4ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_517b8862a76443f09cbee095c54cd4ea", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/517b8862a76443f09cbee095c54cd4ea"}]}] May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 517b8862a76443f09cbee095c54cd4ea May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1782698148 May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: d8c613270c654a21aba84643f4844756 May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1782698148-project May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'f44ae9f8-40e6-4dae-b140-13a8d5cf7885'} May 27 19:57:17.282893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. (HTTP 404) (Request-ID: req-e47dae08-f510-4b54-8c60-218af974c3bb) May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.284051 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 19:57:17.285493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 19:57:17.286946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fd24b6bc-fac4-40b1-be5e-5c206ea5bc14 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] Returning 404 to user: Volume f44ae9f8-40e6-4dae-b140-13a8d5cf7885 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fd24b6bc-fac4-40b1-be5e-5c206ea5bc14 tempest-VolumesSnapshotsTestJSON-1782698148 tempest-VolumesSnapshotsTestJSON-1782698148-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885" status: 404 len: 109 microversion: 2.1 time: 0.035791 May 27 19:57:17.288323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 516/974] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 19:57:17 2022] GET /compute/v2.1/os-volumes/f44ae9f8-40e6-4dae-b140-13a8d5cf7885 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:57:17.789350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:17.789946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:17.796122 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:17.796469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:17.797345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:17.797767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:17.830352 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lazy-loading 'flavor' on Instance uuid 519c8375-9473-4d6f-8efa-e740efe1ce11 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:57:18.066165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f3146aeb-20e8-4b81-99ad-9cd526db0b92 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "POST /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11/action" status: 202 len: 0 microversion: 2.1 time: 0.284597 May 27 19:57:18.066739 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 459/975] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:57:17 2022] POST /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:57:18.075150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:18.075761 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:18.082648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:18.083258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:18.084045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:18.084483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:18.244533 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:18.252144 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-36475c15-9b87-4930-9d94-817e82bb210c tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.180853 May 27 19:57:18.252890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 517/976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:18 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:19.270801 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:19.271501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:19.277732 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:19.278185 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:19.278949 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:19.279383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:19.421905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:19.430960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-127d8545-449b-4c0b-b7f9-9a24a18bf91e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.165317 May 27 19:57:19.440240 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 460/977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:19 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:20.448200 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:20.448808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:20.455606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:20.456049 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:20.457033 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:20.458299 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:20.613043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:20.624144 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-75e6ab20-74fe-4005-9ced-c64838bfebd3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.179566 May 27 19:57:20.624706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 518/978] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:20 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:21.640719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:21.641452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:21.648842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:21.649329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:21.650103 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:21.650538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:21.786954 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:21.797786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-66327c36-0bea-4952-b437-2c121f36c681 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.157815 May 27 19:57:21.797786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 461/979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:21 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:22.811676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:22.812313 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:22.819394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:22.819857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:22.820633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:22.821098 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:22.965930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:22.973490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0994fceb-00fd-403d-b74b-80ad9a68be4f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.165756 May 27 19:57:22.974708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 519/980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:22 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:23.991785 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:23.992389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:23.998969 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:23.999416 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:24.000177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:24.000607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:24.147927 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:24.155565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c065a1b0-c3ec-4f74-8297-f5354df138f5 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.167722 May 27 19:57:24.156128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 462/981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:23 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:25.172601 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:25.173255 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:25.179992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:25.182168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:25.182168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:25.182168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:25.323569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:25.330156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-700e5be7-bdac-4904-a518-e5de09848ee7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.161206 May 27 19:57:25.343468 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 520/982] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:25 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:26.350951 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:26.351576 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:26.358205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:26.358649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:26.359403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:26.359833 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:26.530030 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:26.539812 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-32dd9041-a0d1-4a93-95b3-f1faf03ccc35 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.193169 May 27 19:57:26.540479 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 463/983] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:26 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:27.557668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:27.559705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:27.570969 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:27.571411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:27.572208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:27.572670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:27.782297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:27.794278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bcc1be55-a486-48c1-9b2d-84e6a0eba142 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.240443 May 27 19:57:27.795143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 521/984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:27 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:28.811791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:28.812692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:28.821202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:28.821905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:28.822893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:28.823332 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:28.966250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:28.973932 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1840482d-dec8-4461-9d45-8398217de188 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.166051 May 27 19:57:28.974489 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 464/985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:28 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:57:29.992567 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:29.993147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:29.999807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:30.000490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:30.001456 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:30.001892 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:30.172613 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:30.180619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b2720203-7045-43cc-9e78-1931be754083 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.192708 May 27 19:57:30.181243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 522/986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:29 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:31.198587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:31.198587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:31.209654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.210370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.216922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.216922 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.422609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:31.430008 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c79a8b42-0526-41e4-ae9f-500c8cafe886 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.236179 May 27 19:57:31.430574 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 465/987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:31 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:31.702573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:31.703542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:31.712417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.712944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.713746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.714179 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.743598 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-fcc5bc52-69a7-47e8-9fc4-a3e7cb91f68e tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044880 May 27 19:57:31.744149 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 523/988] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 19:57:31 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:31.807413 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:31.807518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:31.813545 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.814002 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.814772 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:31.815213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:31.843896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:57:32.205412 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3c3e89c9-53cc-439a-b15f-f99414f30540 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 204 len: 0 microversion: 2.20 time: 0.401885 May 27 19:57:32.206345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 466/989] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 19:57:31 2022] DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 19:57:32.215675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:32.216434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:32.222825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.223804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.225713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.226339 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.408018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:32.416160 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:32.417694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:32.418850 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1857561f-0867-4b9d-ba3b-e5492e174926 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.207502 May 27 19:57:32.419404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 524/990] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:32 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:32.450960 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:32.451655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:32.458145 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.458618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.460568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.461137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.605021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:32.612654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ebafe6a0-e724-4eff-870c-3ec71697e544 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1507 microversion: 2.1 time: 0.165961 May 27 19:57:32.613330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 467/991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:32 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:32.629181 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:32.629746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:32.636282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.638471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.638471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.638471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.834690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5b8384d4-516f-4ef6-8650-390e5d672e91 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "POST /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11/action" status: 202 len: 0 microversion: 2.1 time: 0.209299 May 27 19:57:32.837072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 525/992] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:57:32 2022] POST /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 19:57:32.849538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:32.850418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:32.856894 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.857370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:32.858415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:32.859051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:33.019492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:33.033226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-03f14cf5-d5f1-4f8a-892c-5489c3c7419d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1515 microversion: 2.1 time: 0.182467 May 27 19:57:33.034276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 468/993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:32 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:33.437661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:33.438266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:33.444491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:33.444873 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:33.445699 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:33.446129 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:33.671741 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:33.674429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:33.676749 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:33.681919 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e7e21209-7022-4d8b-a0cc-3d74279c7a8b tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1721 microversion: 2.20 time: 0.248240 May 27 19:57:33.682704 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 526/994] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:33 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:34.051206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:34.051870 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:34.058892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.059341 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:34.060121 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.060556 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:34.241141 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:34.249812 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a0d84d5c-61e5-4a3a-a83d-760df9c5f856 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1515 microversion: 2.1 time: 0.202518 May 27 19:57:34.250416 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 469/995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:34 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:34.611434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-b6912657-06a9-4a3a-b921-f45a6f71aa5a req-36a55d40-7adc-40b7-b23d-72a5c129997b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "name": "network-vif-unplugged", "status": "completed", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:34.622018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b6912657-06a9-4a3a-b921-f45a6f71aa5a req-36a55d40-7adc-40b7-b23d-72a5c129997b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.622460 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b6912657-06a9-4a3a-b921-f45a6f71aa5a req-36a55d40-7adc-40b7-b23d-72a5c129997b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:34.634323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.compute.server_external_events [req-b6912657-06a9-4a3a-b921-f45a6f71aa5a req-36a55d40-7adc-40b7-b23d-72a5c129997b service nova] Unable to find a host for instance 519c8375-9473-4d6f-8efa-e740efe1ce11. Dropping event network-vif-unplugged {{(pid=124677) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 19:57:34.635212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-b6912657-06a9-4a3a-b921-f45a6f71aa5a req-36a55d40-7adc-40b7-b23d-72a5c129997b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028028 May 27 19:57:34.635809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 527/996] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 19:57:34.701555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:34.702533 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:34.709107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.713311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:34.713311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.713311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:34.831733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:34.842314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:34.844326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:34.846333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5c104f89-72a5-43a1-b44e-148b98c62a17 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1654 microversion: 2.20 time: 0.148705 May 27 19:57:34.847972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 470/997] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:34 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:34.987237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-c6500a87-9ca9-49d4-b4cc-efef08f39506 req-f6abad71-c312-467c-b977-414146f13ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a561207b-06b1-416c-adaf-8d3330997252", "name": "network-vif-deleted", "tag": "f80fde60-8ed2-401f-a341-69fea8becd00"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:34.998485 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-c6500a87-9ca9-49d4-b4cc-efef08f39506 req-f6abad71-c312-467c-b977-414146f13ad0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:34.999319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-c6500a87-9ca9-49d4-b4cc-efef08f39506 req-f6abad71-c312-467c-b977-414146f13ad0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.024266 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-c6500a87-9ca9-49d4-b4cc-efef08f39506 req-f6abad71-c312-467c-b977-414146f13ad0 service nova] Creating event network-vif-deleted:f80fde60-8ed2-401f-a341-69fea8becd00 for instance a561207b-06b1-416c-adaf-8d3330997252 on hv-cinder-83979 May 27 19:57:35.031215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-c6500a87-9ca9-49d4-b4cc-efef08f39506 req-f6abad71-c312-467c-b977-414146f13ad0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051607 May 27 19:57:35.036142 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 528/998] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:35.267849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:35.268438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:35.279443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:35.281286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.284137 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:35.284752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.447758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:35.449194 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:35.452124 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-14462369-722a-43cf-a50c-80bd443c2659 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1517 microversion: 2.1 time: 0.188492 May 27 19:57:35.452785 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 471/999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:35 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:35.876662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:35.878576 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:35.887937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:35.889901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.890957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:35.891859 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.930265 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:35.930763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:35.931209 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lazy-loading 'fault' on Instance uuid a561207b-06b1-416c-adaf-8d3330997252 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:57:35.976784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:35.984728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:35.986268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed8754ddcfd54c24ac923db0fedc1606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efe5f8c717640528624dc103744dcf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:35.987453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c713eb2d-46e1-4721-90d7-d19334063672 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 200 len: 1371 microversion: 2.20 time: 0.124191 May 27 19:57:35.994079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 529/1000] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:35 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 19:57:36.472540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:36.473179 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:36.480785 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:36.481263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:36.482032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:36.482466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:36.623492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:36.631231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-94e52ddd-aaa9-4e10-9c14-ca5d4eaeb9f8 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.162869 May 27 19:57:36.631892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 472/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:36 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:37.015324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:37.015324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:37.022550 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:37.023106 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:37.023784 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:37.024406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:37.047268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 HTTP/1.1 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:37.053730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:37.055763 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'a561207b-06b1-416c-adaf-8d3330997252'} May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:37.060703 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:37.063100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:37.064815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:37.064815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-57458a8b-1067-4011-867c-67df783e3176 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 404 len: 111 microversion: 2.20 time: 0.044843 May 27 19:57:37.064815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 530/1002] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:37 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:57:37.065084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d0a9382f-c260-458f-863e-ec7e09ee3a56 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '.version_select at 0x7fe1b48ca700>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:37.171199 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d0a9382f-c260-458f-863e-ec7e09ee3a56 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142370934" status: 204 len: 0 microversion: 2.20 time: 0.110743 May 27 19:57:37.172007 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 473/1003] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 19:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142370934 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 19:57:37.649094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:37.649564 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:37.656139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:37.656590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:37.657391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:37.657831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:37.799244 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:37.808261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-df4e92ff-d81e-4357-9b23-482bc61ee28d tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.163544 May 27 19:57:37.818543 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 531/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:37 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:38.826343 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:38.826946 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:38.832815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:38.833324 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:38.834131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:38.834598 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:38.972536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:38.980603 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3c1d0b39-f200-4b76-a391-b9f717b27261 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.158720 May 27 19:57:38.981208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 474/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:38 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:39.170903 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:39.171406 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:39.177801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:39.178255 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:39.179018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:39.179563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:39.192833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 HTTP/1.1 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:39.194409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.196740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'a561207b-06b1-416c-adaf-8d3330997252'} May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:39.197676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.199237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:39.200762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:39.200762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5fb6bdf8-c7b7-4cf6-a7f2-8222699a9b3c tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 404 len: 111 microversion: 2.20 time: 0.029570 May 27 19:57:39.200762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 532/1006] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 19:57:39 2022] DELETE /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:57:39.204863 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:39.205492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: a561207b-06b1-416c-adaf-8d3330997252] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:39.212422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:39.212872 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:39.213673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:39.214108 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:39.227418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 HTTP/1.1 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:39.229120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.231499 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'a561207b-06b1-416c-adaf-8d3330997252'} May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:39.232423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. May 27 19:57:39.233974 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:39.235295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance a561207b-06b1-416c-adaf-8d3330997252 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:39.235295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-11d889ee-f0fc-45a5-b80d-24157384e5a0 tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252" status: 404 len: 111 microversion: 2.20 time: 0.029443 May 27 19:57:39.235295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 475/1007] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:39 2022] GET /compute/v2.1/servers/a561207b-06b1-416c-adaf-8d3330997252 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:57:39.998595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:39.999127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:40.005284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.005733 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.006495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.006929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.142100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:40.163909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d6933aff-b125-41bc-8d8e-08a34574f85f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.155422 May 27 19:57:40.163909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 533/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:39 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:40.491188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:40.492450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:40.498857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.501500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.501500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.501500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.514893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 HTTP/1.1 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 19:57:40.516451 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.520371 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '59595754-b21e-43c4-a3bd-2d0cd810a8d7'} May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:40.521191 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.522653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 19:57:40.524432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:40.524432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d0c73690-ae8b-41b7-846b-c1fc1283071a tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 404 len: 111 microversion: 2.20 time: 0.030527 May 27 19:57:40.524432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 476/1009] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 19:57:40 2022] DELETE /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:57:40.526606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:40.527219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] [instance: 59595754-b21e-43c4-a3bd-2d0cd810a8d7] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:40.533793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.534243 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.535003 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:40.535434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:40.548633 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] HTTP exception thrown: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Request method failure captured: May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 HTTP/1.1 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSt_rxsikJX7Ev8UlmbW8XnY-h7QU-bMUTpN5Xj9OFXBp5BpQVwHob8XlkZZIhj5Jj5W6qKbDB4zQQVrDuEWI0ZGtgT5NelpnPfYcCMxIZd5oquFmpGjFmpvrk7pOFdOVz0Kl9bA9Eg8cF321d6UhOTr39e9KZED57D4hiOoGFploCo May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Openstack-Nova-Api-Version: 2.20 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:57:40.550119 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2efe5f8c717640528624dc103744dcf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2efe5f8c717640528624dc103744dcf4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2efe5f8c717640528624dc103744dcf4"}]}] May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 2efe5f8c717640528624dc103744dcf4 May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2134351474 May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: ed8754ddcfd54c24ac923db0fedc1606 May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2134351474-project May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.551753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '59595754-b21e-43c4-a3bd-2d0cd810a8d7'} May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:57:40.552668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. May 27 19:57:40.554960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:57:40.556394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] Returning 404 to user: Instance 59595754-b21e-43c4-a3bd-2d0cd810a8d7 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:57:40.556394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c7ceb1a2-8e4c-4f55-a7eb-3826c238bd8f tempest-AttachVolumeShelveTestJSON-2134351474 tempest-AttachVolumeShelveTestJSON-2134351474-project] 10.222.0.13 "GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7" status: 404 len: 111 microversion: 2.20 time: 0.028905 May 27 19:57:40.556394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 534/1010] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 19:57:40 2022] GET /compute/v2.1/servers/59595754-b21e-43c4-a3bd-2d0cd810a8d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 19:57:41.170981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:41.171591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:41.177573 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:41.178027 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:41.178788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:41.179266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:41.316250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:41.324098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-167f91e7-030c-466c-abdf-59ca12a34058 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.157215 May 27 19:57:41.324664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 477/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:41 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:57:42.342411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:42.343592 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:42.351671 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:42.352827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:42.353936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:42.355013 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:42.380793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:42.595774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:42.604648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0a57d51c-b856-4853-b79d-49d593a0ee64 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.266338 May 27 19:57:42.605134 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 535/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:42 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:43.622442 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:43.623052 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:43.630135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:43.633756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:43.633756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:43.633756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:43.773486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:43.781764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-00698455-6613-4816-b65c-89fbfe37eced tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.163132 May 27 19:57:43.792583 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 478/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:43 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:44.798820 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:44.799441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:44.807218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:44.807816 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:44.809470 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:44.810120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:45.026349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:45.034428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0d6cdfc3-2946-4eed-a07f-4619c919251e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.239542 May 27 19:57:45.035123 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 536/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:44 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:46.051578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:46.052243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:46.054709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:46.059546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:46.060052 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:46.060757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:46.061215 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:46.196695 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:46.216871 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-47ceceae-0b7c-48d6-9677-1e384c029325 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.169035 May 27 19:57:46.217492 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 479/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:46 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:46.663982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-08ec514f-34f1-42bf-85a6-c01362310957 req-5c362d62-b085-4254-a993-385b971e430f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "name": "network-vif-plugged", "status": "completed", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:46.668372 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=45 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:46.673638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-08ec514f-34f1-42bf-85a6-c01362310957 req-5c362d62-b085-4254-a993-385b971e430f service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:46.674074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-08ec514f-34f1-42bf-85a6-c01362310957 req-5c362d62-b085-4254-a993-385b971e430f service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:46.688524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-08ec514f-34f1-42bf-85a6-c01362310957 req-5c362d62-b085-4254-a993-385b971e430f service nova] Creating event network-vif-plugged:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:57:46.694012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-08ec514f-34f1-42bf-85a6-c01362310957 req-5c362d62-b085-4254-a993-385b971e430f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034395 May 27 19:57:46.694684 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 537/1016] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:57:47.242709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:47.243465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:47.250171 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:47.254794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:47.254794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:47.254794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:47.400486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:47.404092 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ab459196-5c4f-4fac-86cc-062073457069 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.166763 May 27 19:57:47.405177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 480/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:47 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:48.422643 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:48.423342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:48.437393 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:48.438214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:48.439202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:48.439868 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:48.660059 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:48.675522 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d1ffcc0e-78ef-49d2-b657-776ac1438acb tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1573 microversion: 2.1 time: 0.257416 May 27 19:57:48.681080 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 538/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:48 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1573 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:49.699012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:49.699629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:49.706287 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:49.706773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:49.707567 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:49.708233 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:49.882494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:49.890973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6a6f0265-2c1e-42cb-a6d9-411c9c6fb1b7 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1560 microversion: 2.1 time: 0.196534 May 27 19:57:49.891547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 481/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:49 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:51.995043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b455b599-7bc8-4e1f-ab13-f894610479b5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: .version_select at 0x7fe1b4b77c10>, body: {"keypair": {"name": "tempest-keypair-1449625186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDAKbLH8BJL2G/L27L1lTUpjBM0er5P9qBpHrDZbNp8MbfzW1JG1KDEDbvHg08Ka79SxBu3n+DDp4D90jnuivY1LKNpMM6xd1+OEXEgXfQTsds2csjHlnwbgyliRiTMwQ=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:52.011026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-b455b599-7bc8-4e1f-ab13-f894610479b5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for project 51d8222fe16e403999de6fc5803b50d3. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:57:52.017120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-b455b599-7bc8-4e1f-ab13-f894610479b5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for user bcdd3f30e42b41308b69e1233686cc17 and project 51d8222fe16e403999de6fc5803b50d3. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:57:52.135775 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b455b599-7bc8-4e1f-ab13-f894610479b5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266155 May 27 19:57:52.136561 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 539/1020] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 19:57:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:57:54.952557 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1652923263", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e484a0-a4a2-4a8e-af59-45dc8093ee16"}], "security_groups": [{"name": "tempest-securitygroup--140205055"}], "key_name": "tempest-keypair-1449625186", "user_data": "}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:55.066983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] validate_networks() for [('52e484a0-a4a2-4a8e-af59-45dc8093ee16', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 19:57:55.478690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 19:57:55.479135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 19:57:55.479612 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 19:57:55.480021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 19:57:55.480430 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 19:57:55.489506 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:55.489958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:55.491296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:55.492013 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:55.511604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for project 51d8222fe16e403999de6fc5803b50d3. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 19:57:55.516070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for user bcdd3f30e42b41308b69e1233686cc17 and project 51d8222fe16e403999de6fc5803b50d3. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 19:57:55.528820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 19:57:55.531129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 19:57:55.667114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e7b95982-84e1-411e-86f6-9b9d4093aa6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.718865 May 27 19:57:55.667761 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 482/1021] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 19:57:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 19:57:55.677728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4df905c0-a6cb-4c7a-aee9-8a9d85c4a22f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:55.680040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4df905c0-a6cb-4c7a-aee9-8a9d85c4a22f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:55.760075 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4df905c0-a6cb-4c7a-aee9-8a9d85c4a22f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:55.768394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4df905c0-a6cb-4c7a-aee9-8a9d85c4a22f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1238 microversion: 2.1 time: 0.094492 May 27 19:57:55.769140 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 540/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:55 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:56.786779 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:56.787449 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:56.793730 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:56.794174 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:56.794934 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:56.795367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:56.861977 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:56.870330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dbb600a4-02a8-4150-87c4-3bce7665a10c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1242 microversion: 2.1 time: 0.088077 May 27 19:57:56.877322 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 483/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:56 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:57.888234 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:57.888813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:57.895175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:57.895619 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:57.896606 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:57.897097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:57.976504 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:57.984553 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-07dcdd4a-abcf-4cd0-ab82-82714a41f79c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1298 microversion: 2.1 time: 0.100291 May 27 19:57:57.985220 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 541/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:57 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:59.002319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:57:59.002921 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:57:59.010038 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:59.010483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:59.011242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:59.011791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:59.143056 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:57:59.151196 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9b0827c1-574a-45ef-aa21-f54d72cbb5e0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.152791 May 27 19:57:59.155678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 484/1025] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:57:58 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:57:59.655250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1c2c61c8-8c2c-46c2-bf7b-1812f4bccda5 req-9db55bcc-86ea-4f00-8859-1564e2870396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cce55b5-d6fd-4066-a3e5-79728532f74b", "tag": "a1fe640c-d9d7-413f-a327-92aef335105f"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:57:59.665745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1c2c61c8-8c2c-46c2-bf7b-1812f4bccda5 req-9db55bcc-86ea-4f00-8859-1564e2870396 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:57:59.666319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1c2c61c8-8c2c-46c2-bf7b-1812f4bccda5 req-9db55bcc-86ea-4f00-8859-1564e2870396 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:57:59.678641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1c2c61c8-8c2c-46c2-bf7b-1812f4bccda5 req-9db55bcc-86ea-4f00-8859-1564e2870396 service nova] Creating event network-changed:a1fe640c-d9d7-413f-a327-92aef335105f for instance 1cce55b5-d6fd-4066-a3e5-79728532f74b on hv-cinder-83979 May 27 19:57:59.683961 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1c2c61c8-8c2c-46c2-bf7b-1812f4bccda5 req-9db55bcc-86ea-4f00-8859-1564e2870396 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034083 May 27 19:57:59.684640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 542/1026] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:58:00.168253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:00.168857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:00.175693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:00.176236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:00.177170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:00.178780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:00.327897 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:00.336156 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7bda42b7-ca76-42cf-83fa-e204564e41c4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.171838 May 27 19:58:00.345427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 485/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:00 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:01.354678 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:01.355409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:01.361652 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:01.362108 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:01.362879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:01.363327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:01.494562 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:01.501974 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a9a998e3-80a1-4394-88e6-d87c2398b0bd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.152897 May 27 19:58:01.502546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 543/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:01 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:02.518364 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:02.519032 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:02.525719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:02.526159 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:02.526923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:02.527354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:02.657336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:02.665572 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-004ea68c-d465-46a3-b5e5-5b906904c242 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.151016 May 27 19:58:02.666140 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 486/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:02 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:03.682840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:03.683660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:03.690166 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:03.690610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:03.691370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:03.691807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:03.824120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:03.831760 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-75fc0886-1772-4e5d-9143-e0bf94f32232 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.152992 May 27 19:58:03.832319 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 544/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:03 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:04.850481 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:04.851410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:04.857699 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:04.858245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:04.859010 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:04.859444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:05.005839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:05.013578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-53bea811-a915-443b-b410-f383450323fe tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.167668 May 27 19:58:05.014143 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 487/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:04 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:06.030455 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:06.031057 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:06.033565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:06.039145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:06.039588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:06.040344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:06.040775 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:06.175578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:06.183079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b2a5d361-83a0-4dd9-94f3-a27e5d12a4e7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.156378 May 27 19:58:06.183577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 545/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:06 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:06.841488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-a8981f40-2eba-4015-a483-fab7b5023e04 req-e4a61c8d-25a8-4b46-b881-b9d2714d578d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cce55b5-d6fd-4066-a3e5-79728532f74b", "name": "network-vif-plugged", "status": "completed", "tag": "a1fe640c-d9d7-413f-a327-92aef335105f"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:58:06.846239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:06.851432 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:06.854212 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-a8981f40-2eba-4015-a483-fab7b5023e04 req-e4a61c8d-25a8-4b46-b881-b9d2714d578d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:06.854748 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-a8981f40-2eba-4015-a483-fab7b5023e04 req-e4a61c8d-25a8-4b46-b881-b9d2714d578d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:06.858693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=79 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:06.870568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-a8981f40-2eba-4015-a483-fab7b5023e04 req-e4a61c8d-25a8-4b46-b881-b9d2714d578d service nova] Creating event network-vif-plugged:a1fe640c-d9d7-413f-a327-92aef335105f for instance 1cce55b5-d6fd-4066-a3e5-79728532f74b on hv-cinder-83979 May 27 19:58:06.875807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-a8981f40-2eba-4015-a483-fab7b5023e04 req-e4a61c8d-25a8-4b46-b881-b9d2714d578d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038506 May 27 19:58:06.876427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 488/1033] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 19:58:07.200379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:07.201126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:07.208907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:07.209566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:07.210414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:07.210845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:07.352342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:07.359972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-70a78034-ee82-4a29-8d6f-12a9b6580427 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.164123 May 27 19:58:07.360534 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 546/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:07 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:08.379535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:08.379535 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:08.387028 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:08.387480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:08.388239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:08.388673 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:08.520418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:08.528794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ed981e7d-7c7d-4502-b381-ec1c6493f035 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1363 microversion: 2.1 time: 0.155166 May 27 19:58:08.529495 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 489/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:08 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:09.545887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:09.546500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:09.552825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:09.553301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:09.554082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:09.554512 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:09.688369 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:09.696213 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9e6ae9d3-4043-48c0-80c9-438f8a624d14 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1550 microversion: 2.1 time: 0.154182 May 27 19:58:09.696705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 547/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:09 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:09.716223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:09.716790 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:09.723279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:09.723729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:09.724609 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:09.725142 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:09.804407 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4249d710-9876-4534-a05b-5032d486bb7e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092969 May 27 19:58:09.805020 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 490/1037] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 19:58:09 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:58:11.026074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-a7b6f2a1-1561-44d3-a172-7b0f76b650e8 req-463a3c38-84d1-4383-aab2-4819775f8127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cce55b5-d6fd-4066-a3e5-79728532f74b", "tag": "a1fe640c-d9d7-413f-a327-92aef335105f"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:58:11.034642 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a7b6f2a1-1561-44d3-a172-7b0f76b650e8 req-463a3c38-84d1-4383-aab2-4819775f8127 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:11.035077 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a7b6f2a1-1561-44d3-a172-7b0f76b650e8 req-463a3c38-84d1-4383-aab2-4819775f8127 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:11.054530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-a7b6f2a1-1561-44d3-a172-7b0f76b650e8 req-463a3c38-84d1-4383-aab2-4819775f8127 service nova] Creating event network-changed:a1fe640c-d9d7-413f-a327-92aef335105f for instance 1cce55b5-d6fd-4066-a3e5-79728532f74b on hv-cinder-83979 May 27 19:58:11.059596 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-a7b6f2a1-1561-44d3-a172-7b0f76b650e8 req-463a3c38-84d1-4383-aab2-4819775f8127 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 May 27 19:58:11.060205 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 548/1038] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:58:46.063227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:46.064369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=11 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:46.068269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:46.068752 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:46.075628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:46.076102 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:46.076874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:46.077367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:46.100843 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ab20978a-5279-4ab5-aa24-9e20350fbff7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/ips" status: 200 len: 146 microversion: 2.1 time: 0.039223 May 27 19:58:46.101436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 491/1039] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 19:58:46 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:58:48.409791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:48.410542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=56 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:48.414791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e45b314a-b2ca-49ca-94e8-1e8a1a3bb4fc"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:58:48.417611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:48.422623 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:48.423074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:48.423831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:48.424268 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:49.144807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-82320e66-9da1-4331-81a6-c9af3fe61b79 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736425 May 27 19:58:49.145581 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 549/1040] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 19:58:48 2022] POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:58:56.634968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ecd111c5-91d5-4a82-8b89-fcbc61279c21 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:58:56.642734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ecd111c5-91d5-4a82-8b89-fcbc61279c21 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:56.643180 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-ecd111c5-91d5-4a82-8b89-fcbc61279c21 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:56.702329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ecd111c5-91d5-4a82-8b89-fcbc61279c21 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Going to try to stop instance {{(pid=124678) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 19:58:56.865034 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ecd111c5-91d5-4a82-8b89-fcbc61279c21 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.234265 May 27 19:58:56.865544 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 492/1041] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:58:56 2022] POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:58:56.874170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:56.875024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:56.882738 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:56.883185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:56.883956 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:56.884392 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:57.017137 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:57.025324 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-522ebe34-0f80-4f66-8258-b89aca0e68ae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.155398 May 27 19:58:57.025888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 550/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:56 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:58.043658 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:58.044345 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:58.051439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:58.051816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:58.052571 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:58.053017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:58.184415 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:58.193118 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f7b7892a-d3f9-44a9-b7b8-fa41b455dd1b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.154070 May 27 19:58:58.193687 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 493/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:58 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:58:59.211040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:58:59.211640 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:58:59.218342 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:59.218797 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:59.219675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:58:59.220198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:58:59.350497 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:58:59.358533 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-315312a0-ce2b-488e-9d3f-49ab5e5b4da5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.151594 May 27 19:58:59.362463 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 551/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:58:59 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:00.376764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:00.377388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:00.383820 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:00.384267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:00.385045 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:00.385481 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:00.512992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:00.521427 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9dd892d0-5d85-44e8-bfb5-d22735dee0d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.149059 May 27 19:59:00.521992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 494/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:00 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:01.538439 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:01.539055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:01.545505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:01.545950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:01.546708 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:01.547145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:01.680688 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:01.688687 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-33a320de-8a1a-462a-b87a-356ce7212156 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.154082 May 27 19:59:01.689279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 552/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:01 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:59:02.705538 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:02.706229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:02.713205 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:02.713744 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:02.714587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:02.715114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:02.848900 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:02.857035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9bca6f00-a756-48f8-9ad0-948bff11c7d4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.156037 May 27 19:59:02.857605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 495/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:02 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:03.034752 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:03.035674 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-173c8a8b-4767-4783-b9f3-9fb64e40e6a5 req-c9124c2b-4f14-44e0-be01-572c0db9cc9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:59:03.036356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:03.043724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.044269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.045058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-173c8a8b-4767-4783-b9f3-9fb64e40e6a5 req-c9124c2b-4f14-44e0-be01-572c0db9cc9f service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.045309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.045528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-173c8a8b-4767-4783-b9f3-9fb64e40e6a5 req-c9124c2b-4f14-44e0-be01-572c0db9cc9f service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.046175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.056938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-173c8a8b-4767-4783-b9f3-9fb64e40e6a5 req-c9124c2b-4f14-44e0-be01-572c0db9cc9f service nova] Creating event network-changed:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:59:03.062123 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-173c8a8b-4767-4783-b9f3-9fb64e40e6a5 req-c9124c2b-4f14-44e0-be01-572c0db9cc9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030318 May 27 19:59:03.063575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 496/1048] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:59:03.076227 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Going to try to terminate instance {{(pid=124677) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 19:59:03.301572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-edb9bbfc-2b06-48ad-bb0f-83018af428a2 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 204 len: 0 microversion: 2.1 time: 0.271685 May 27 19:59:03.302410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 553/1049] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 19:59:03 2022] DELETE /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 19:59:03.314021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:03.314021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:03.322428 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.323152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.324142 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.324905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.461982 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:03.469686 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-54c13a6e-6ab9-4259-bedd-b080807370f3 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.162413 May 27 19:59:03.470355 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 497/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:03 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:03.876065 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:03.876773 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:03.883247 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.883866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:03.884649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:03.885118 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:04.030860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:04.039769 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ba4ea8e7-d6dd-4f10-b4d3-6949f67b3c64 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.168610 May 27 19:59:04.041180 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 554/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:03 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:04.486521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:04.487247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:04.493861 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:04.494300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:04.495061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:04.495488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:04.628474 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:04.636121 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e0685dff-c32f-45db-8914-0a99cee79439 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1566 microversion: 2.1 time: 0.153600 May 27 19:59:04.636775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 498/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:04 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:05.057647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:05.058269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:05.064762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:05.065237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:05.066008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:05.066506 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:05.457791 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:05.465878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a6ddf4d5-9eca-46f8-804e-f5c0acf47831 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.412131 May 27 19:59:05.466445 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 555/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:05 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:05.561622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-2630e921-1e71-4a50-b8ee-1fcd262b305b req-07e84d52-9984-4807-b9fb-829b506d4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "519c8375-9473-4d6f-8efa-e740efe1ce11", "name": "network-vif-deleted", "tag": "f5c08d28-fe37-44f8-b936-d4307075da0a"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:59:05.570864 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-2630e921-1e71-4a50-b8ee-1fcd262b305b req-07e84d52-9984-4807-b9fb-829b506d4d3d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:05.571301 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-2630e921-1e71-4a50-b8ee-1fcd262b305b req-07e84d52-9984-4807-b9fb-829b506d4d3d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:05.582542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-2630e921-1e71-4a50-b8ee-1fcd262b305b req-07e84d52-9984-4807-b9fb-829b506d4d3d service nova] Creating event network-vif-deleted:f5c08d28-fe37-44f8-b936-d4307075da0a for instance 519c8375-9473-4d6f-8efa-e740efe1ce11 on hv-cinder-83979 May 27 19:59:05.587374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-2630e921-1e71-4a50-b8ee-1fcd262b305b req-07e84d52-9984-4807-b9fb-829b506d4d3d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029375 May 27 19:59:05.587944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 499/1054] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 19:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 19:59:05.653987 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:05.654625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:05.661173 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:05.661554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:05.662312 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:05.662742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:05.724625 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:05.732667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-360574e3-5939-4a80-b28c-0cd1be28fa5f tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1380 microversion: 2.1 time: 0.082613 May 27 19:59:05.733500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 556/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:05 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:06.483548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:06.484277 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:06.491255 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:06.491710 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:06.492480 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:06.492912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:06.630337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:06.638421 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-03a3bfac-898f-4b3e-8b61-bef05ea8210a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.159159 May 27 19:59:06.638978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 500/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:06 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:06.750062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:06.751367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:06.758078 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:06.758517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:06.759286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:06.759717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:06.790128 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:06.790507 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:06.790951 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lazy-loading 'fault' on Instance uuid 519c8375-9473-4d6f-8efa-e740efe1ce11 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:59:06.833609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ef94416f1741a88c1e18106cad8b2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f2a07b1f3646209dfdc37dcd2b755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:06.841048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c4e08fc6-ed2d-4e84-bde3-ff2781ed033e tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 200 len: 1222 microversion: 2.1 time: 0.094885 May 27 19:59:06.841604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 557/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:06 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:07.655724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:07.656331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:07.662694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:07.663138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:07.663905 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:07.664339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:07.790026 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:07.798537 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6a0e2267-ca42-476d-845d-3225c522d30d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.146721 May 27 19:59:07.799092 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 501/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:07 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:07.857590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:07.858197 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] [instance: 519c8375-9473-4d6f-8efa-e740efe1ce11] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:07.865337 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:07.865786 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:07.866556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:07.866985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:07.882803 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] HTTP exception thrown: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Request method failure captured: May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 HTTP/1.1 May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikSx12vu2RWO2KWmTZpUHwc5eDgzi9MJnTrEyc8dxLAj-CAg6SfwQ3VCY8J_hX_xU_AzDTbYL7McxQAMgtI8aZrxAaFrmPqohzxtn0F4IzF7DC2oqCMxE4E6qMew8i0g5_jAMiQLDMJCTDiZ25xPLLYi1YkRtZq5kgO2_jX2T3-qD2OU May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 28f2a07b1f3646209dfdc37dcd2b755e May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-TestShelveInstance-271120499 May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 19:59:07.884431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/28f2a07b1f3646209dfdc37dcd2b755e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/28f2a07b1f3646209dfdc37dcd2b755e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_28f2a07b1f3646209dfdc37dcd2b755e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/28f2a07b1f3646209dfdc37dcd2b755e"}]}] May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-TestShelveInstance-271120499 May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 28f2a07b1f3646209dfdc37dcd2b755e May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-TestShelveInstance-271120499 May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-TestShelveInstance-271120499-project May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 67ef94416f1741a88c1e18106cad8b2c May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-TestShelveInstance-271120499-project May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. May 27 19:59:07.886201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '519c8375-9473-4d6f-8efa-e740efe1ce11'} May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 19:59:07.887207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. May 27 19:59:07.888845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 19:59:07.890399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Returning 404 to user: Instance 519c8375-9473-4d6f-8efa-e740efe1ce11 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 19:59:07.890399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8a1b0bec-77d1-4db8-a120-e628fad26a3a tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11" status: 404 len: 111 microversion: 2.1 time: 0.032047 May 27 19:59:07.890399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 558/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:07 2022] GET /compute/v2.1/servers/519c8375-9473-4d6f-8efa-e740efe1ce11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 19:59:08.145948 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6c281d5a-c766-443f-8c13-56cf64980847 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] Calling method '.version_select at 0x7fe1b48a0c10>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:08.228305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6c281d5a-c766-443f-8c13-56cf64980847 tempest-TestShelveInstance-271120499 tempest-TestShelveInstance-271120499-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-540601896" status: 202 len: 0 microversion: 2.1 time: 0.086177 May 27 19:59:08.228891 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 502/1060] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 19:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-540601896 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:59:08.814735 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:08.815343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:08.821387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:08.829167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:08.829167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:08.829167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:08.953555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:08.961851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c6d459d0-5939-4925-9490-f61850f42eab tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.151212 May 27 19:59:08.962418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 559/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:08 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:09.978990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:09.979751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:09.988155 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:09.988698 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:09.989529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:09.990070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:10.213225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:10.222784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4683358a-5649-4ad8-8c82-13a49689fe3e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.247731 May 27 19:59:10.223454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 503/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:09 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:11.240655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:11.242010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:11.249673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:11.250124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:11.251162 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:11.252269 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:11.416000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:11.429004 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-cb82af39-07dd-4005-ac1a-c7f2b5339d5b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1724 microversion: 2.1 time: 0.192823 May 27 19:59:11.429955 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 560/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:11 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:12.446521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:12.447131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:12.453958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:12.454401 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:12.455167 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:12.455640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:12.592374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:12.601762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f8b584af-878f-4773-9eac-d81c334b1ce3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1701 microversion: 2.1 time: 0.159263 May 27 19:59:12.602257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 504/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:12 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:12.618933 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6a6d8a9d-af1c-4287-ac8d-5040790812b3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:59:12.625566 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6a6d8a9d-af1c-4287-ac8d-5040790812b3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:12.626125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6a6d8a9d-af1c-4287-ac8d-5040790812b3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:12.689026 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6a6d8a9d-af1c-4287-ac8d-5040790812b3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Going to try to start instance {{(pid=124677) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 19:59:12.819304 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:12.940170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6a6d8a9d-af1c-4287-ac8d-5040790812b3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.324711 May 27 19:59:12.940980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 561/1065] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:59:12 2022] POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:59:12.949152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:12.956037 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:12.956892 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:12.957580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:12.958550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:12.959202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:13.097443 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:13.107500 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-16c96e3e-b022-4df6-8bfc-8ac0e7bb2e15 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1710 microversion: 2.1 time: 0.161293 May 27 19:59:13.108632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 505/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:12 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:14.126483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:14.127356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:14.135027 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:14.135323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:14.136457 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:14.136721 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:14.332491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:14.340617 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-0bbe0a44-f40f-43a8-8005-2751d89c5ae8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1710 microversion: 2.1 time: 0.219307 May 27 19:59:14.341223 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 562/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:14 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:15.358485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:15.359069 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:15.366005 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:15.366454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:15.367226 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:15.367655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:15.521958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:15.530507 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-07ad67a4-67d1-43d1-8e76-cf61d72224f2 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1714 microversion: 2.1 time: 0.175880 May 27 19:59:15.537882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 506/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:15 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1714 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:46.965532 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:46.966143 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:46.968298 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:46.968937 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:46.974284 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:46.974724 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:46.975484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:46.975913 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:47.055839 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lazy-loading 'services' on Instance uuid 1cce55b5-d6fd-4066-a3e5-79728532f74b {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 19:59:47.275679 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9dbb38d7-4a45-43f6-97a9-e709a926ecb1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments/e45b314a-b2ca-49ca-94e8-1e8a1a3bb4fc" status: 202 len: 0 microversion: 2.1 time: 0.313769 May 27 19:59:47.276189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 563/1069] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 19:59:46 2022] DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments/e45b314a-b2ca-49ca-94e8-1e8a1a3bb4fc => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:59:48.386581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c13de968-f5d1-4559-858d-75f640f2114f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:59:48.388910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:48.389582 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:48.394328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c13de968-f5d1-4559-858d-75f640f2114f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:48.394775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c13de968-f5d1-4559-858d-75f640f2114f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:48.417300 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c13de968-f5d1-4559-858d-75f640f2114f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Going to try to stop instance {{(pid=124678) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 19:59:48.645014 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c13de968-f5d1-4559-858d-75f640f2114f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.261937 May 27 19:59:48.645550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 507/1070] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:59:48 2022] POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:59:48.654689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:48.655418 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:48.662985 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:48.663435 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:48.664206 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:48.664636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:48.802387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:48.810042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a963e3bc-7c31-43a6-a840-f4b41ce193ea tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.159953 May 27 19:59:48.810762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 564/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:48 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 19:59:49.828980 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:49.829645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:49.837968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:49.841457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:49.841457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:49.841457 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:49.971767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:49.979209 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1478b815-a54f-4b52-9137-544cf7cb2c35 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.155003 May 27 19:59:49.979808 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 508/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:49 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:50.996804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:50.997434 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:51.003973 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:51.004441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:51.005221 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:51.005652 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:51.133412 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:51.140780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-947ba4fa-89d4-4c8c-9886-79e6e923808d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.147940 May 27 19:59:51.141376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 565/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:50 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:52.158669 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:52.159369 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:52.165814 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:52.166251 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:52.167012 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:52.167439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:52.297237 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:52.305245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-69d8a9db-ae07-4c17-b7d2-c2965e47f33a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.150531 May 27 19:59:52.305798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 509/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:52 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:53.322335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:53.322947 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:53.329514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:53.330226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:53.331387 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:53.331825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:53.457453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:53.464805 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-87823507-d83c-40d4-aa4d-5a24d4fb8a37 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.146387 May 27 19:59:53.465395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 566/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:53 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:54.482355 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:54.482953 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:54.489885 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:54.490327 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:54.491084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:54.491515 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:54.625134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:54.633336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f5c102af-b742-4b93-907f-e2afa57bdef4 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.154783 May 27 19:59:54.633888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 510/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:54 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:55.650309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:55.650897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:55.657527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:55.657977 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:55.659283 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:55.659742 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:55.788450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:55.795862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6ff118bd-990f-423b-842f-2df40f9f1a33 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.149419 May 27 19:59:55.796551 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 567/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:55 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:56.814091 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:56.814824 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:56.822250 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:56.822694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:56.823452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:56.823882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:56.951177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:56.959128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d56c6d4d-5b67-4270-b430-38e74836e460 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.148857 May 27 19:59:56.959694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 511/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:56 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:57.976084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:57.976689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:57.983458 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:57.983902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:57.984661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:57.985139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:58.111901 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:58.119367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3bab3033-5504-4ddc-8af0-b320edb75d3f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1678 microversion: 2.1 time: 0.147188 May 27 19:59:58.119921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 568/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:57 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:59.136213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:59.136853 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:59.143677 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:59.144031 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:59.144811 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:59.145645 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:59.272908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:59.280333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e003259a-adea-4cc8-85a8-b40cc2a32e66 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1655 microversion: 2.1 time: 0.148164 May 27 19:59:59.280896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 512/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:59 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 19:59:59.296841 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9e37f876-b1d1-4ade-8394-7844a9d1169a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 19:59:59.304025 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e37f876-b1d1-4ade-8394-7844a9d1169a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:59.304473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9e37f876-b1d1-4ade-8394-7844a9d1169a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:59.325802 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9e37f876-b1d1-4ade-8394-7844a9d1169a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Going to try to start instance {{(pid=124677) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 19:59:59.500384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9e37f876-b1d1-4ade-8394-7844a9d1169a tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.207158 May 27 19:59:59.501072 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 569/1081] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 19:59:59 2022] POST /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 19:59:59.509552 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 19:59:59.510166 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 19:59:59.516095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:59.516555 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:59.517336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 19:59:59.517803 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 19:59:59.651981 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 19:59:59.660075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b4a22970-e733-4efe-b205-30cf9161768b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1664 microversion: 2.1 time: 0.153933 May 27 19:59:59.660874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 513/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 19:59:59 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:00.678375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:00.679067 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:00.685340 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:00.685779 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:00.686522 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:00.686950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:00.823398 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:00.831965 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-724973a3-5a8f-422e-b470-37b59c109ca9 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1664 microversion: 2.1 time: 0.157790 May 27 20:00:00.832645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 570/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:00 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:01.849724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:01.850272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:01.856551 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:01.857019 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:01.857777 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:01.858206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:01.985968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:01.993536 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7b20e7c5-401a-4b93-aba2-d61da18367a1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1668 microversion: 2.1 time: 0.148299 May 27 20:00:01.994104 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 514/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:01 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:19.795316 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:00:19.795990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:00:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:00:23.654236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:00:23.654762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:00:30.440201 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:30.441241 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:30.443481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=16 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:30.444827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:30.449086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.461915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:30.461915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.461915 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:30.482637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-c2d068f9-335d-464c-a81f-94354460fb11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046311 May 27 20:00:30.484817 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 571/1085] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 20:00:30 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 20:00:30.550384 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:30.550913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:30.555992 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=16 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:30.557232 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:30.562190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.564942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:30.564942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.564942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:30.592260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:00:30.897241 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9c923e20-e4c9-4bcd-9b2a-fdf00391f154 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 204 len: 0 microversion: 2.1 time: 0.353977 May 27 20:00:30.897822 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 515/1086] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:00:30 2022] DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:00:30.909638 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:30.910930 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:30.921556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.922086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:30.922862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:30.923302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:31.259045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:31.266462 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ec3ce432-a119-4536-bc78-d4ff0a260cd1 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1674 microversion: 2.1 time: 0.364316 May 27 20:00:31.267016 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 572/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:30 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1674 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:32.284314 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:32.285035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:32.291568 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:32.292023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:32.292787 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:32.293263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:32.490426 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:32.498084 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-71a3a3c7-2fa2-436c-ab82-3749b50eec6b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1674 microversion: 2.1 time: 0.218002 May 27 20:00:32.498672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 516/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:32 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:33.515936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:33.516499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:33.523964 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:33.528840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:33.528840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:33.528840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:33.819751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:33.839636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b168836a-f3e9-43bc-898b-499e27d93d9c tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 200 len: 1607 microversion: 2.1 time: 0.316750 May 27 20:00:33.839636 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 573/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:33 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 1607 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:33.885639 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-5d92c5bb-e542-44ee-a8a3-152c218c448e req-7fbbf765-0d75-4dd0-a582-b96ce13aa0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cce55b5-d6fd-4066-a3e5-79728532f74b", "name": "network-vif-deleted", "tag": "a1fe640c-d9d7-413f-a327-92aef335105f"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:33.895089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-5d92c5bb-e542-44ee-a8a3-152c218c448e req-7fbbf765-0d75-4dd0-a582-b96ce13aa0ec service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:33.895617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-5d92c5bb-e542-44ee-a8a3-152c218c448e req-7fbbf765-0d75-4dd0-a582-b96ce13aa0ec service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:33.908793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-5d92c5bb-e542-44ee-a8a3-152c218c448e req-7fbbf765-0d75-4dd0-a582-b96ce13aa0ec service nova] Creating event network-vif-deleted:a1fe640c-d9d7-413f-a327-92aef335105f for instance 1cce55b5-d6fd-4066-a3e5-79728532f74b on hv-cinder-83979 May 27 20:00:33.913700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-5d92c5bb-e542-44ee-a8a3-152c218c448e req-7fbbf765-0d75-4dd0-a582-b96ce13aa0ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 May 27 20:00:33.914282 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 517/1090] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:00:34.268254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:00:34.268555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:00:34.845720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:34.846952 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:34.853336 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:34.859260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:34.859260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:34.859260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:34.871487 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b HTTP/1.1 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:00:34.873168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:00:34.874743 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '1cce55b5-d6fd-4066-a3e5-79728532f74b'} May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:00:34.875609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:00:34.877040 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:00:34.886289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:00:34.886289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-30b15d03-f680-44f2-aa10-f79daba339f3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 404 len: 111 microversion: 2.1 time: 0.032749 May 27 20:00:34.886289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 574/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:34 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:00:34.886565 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-cf45e3b1-bd81-422e-99be-4baa0cb62c31 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '.version_select at 0x7fe1b48ea280>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:34.947384 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-cf45e3b1-bd81-422e-99be-4baa0cb62c31 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449625186" status: 202 len: 0 microversion: 2.1 time: 0.066871 May 27 20:00:34.947968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 518/1092] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 20:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449625186 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:00:35.707218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b989e9e1-9e23-499d-8363-47931536e424 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: .version_select at 0x7fe1b4b7f1f0>, body: {"keypair": {"name": "tempest-keypair-521206678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONcVhczZywH186zGMcvyO2u/y5jzbr3xJejRe/fdGaQCBMtf2H3gwmWNfu6/qowXhwC6SYfuiR/+yxCI3aF8FF7pD+yPwHHS5NU3EDZVqo+db/lt5WtpEjVJSnszihfYQ=="}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:35.721001 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-b989e9e1-9e23-499d-8363-47931536e424 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for project 51d8222fe16e403999de6fc5803b50d3. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:00:35.724812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-b989e9e1-9e23-499d-8363-47931536e424 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for user bcdd3f30e42b41308b69e1233686cc17 and project 51d8222fe16e403999de6fc5803b50d3. Resources: {'key_pairs'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:00:35.838242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b989e9e1-9e23-499d-8363-47931536e424 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135177 May 27 20:00:35.838831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 575/1093] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 20:00:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:00:38.087070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1660155506", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52e484a0-a4a2-4a8e-af59-45dc8093ee16"}], "security_groups": [{"name": "tempest-securitygroup--343965787"}], "key_name": "tempest-keypair-521206678", "user_data": "}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:38.187286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] validate_networks() for [('52e484a0-a4a2-4a8e-af59-45dc8093ee16', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:00:38.601333 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:00:38.601749 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:00:38.602216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:00:38.602616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:00:38.603017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:00:38.612252 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:38.612694 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:38.613518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:38.613944 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:38.630471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for project 51d8222fe16e403999de6fc5803b50d3. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:00:38.634323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Getting quotas for user bcdd3f30e42b41308b69e1233686cc17 and project 51d8222fe16e403999de6fc5803b50d3. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:00:38.645056 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:00:38.647336 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:00:38.767373 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-30d27298-2266-4ed0-8a0c-72a33002c8c8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685191 May 27 20:00:38.768207 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 519/1094] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:00:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 20:00:38.778833 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-bde16bad-e1c0-459d-93bb-b9765848c233 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:38.781250 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-bde16bad-e1c0-459d-93bb-b9765848c233 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:38.839014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-bde16bad-e1c0-459d-93bb-b9765848c233 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:38.846241 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-bde16bad-e1c0-459d-93bb-b9765848c233 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1237 microversion: 2.1 time: 0.071727 May 27 20:00:38.847018 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 576/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:38 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:39.863510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:39.864044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:39.871708 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:39.872158 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:39.872931 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:39.873388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:39.939043 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:39.947388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-84464857-a806-4e6f-ad6d-74b51c0f2553 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1241 microversion: 2.1 time: 0.088038 May 27 20:00:39.947988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 520/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:39 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:40.966097 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:40.966824 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:40.974716 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:40.975391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:40.976130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:40.976628 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:41.064300 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:41.071584 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-09c5b7f8-bf9e-4619-b847-71b3af9a7ea0 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1295 microversion: 2.1 time: 0.110489 May 27 20:00:41.072149 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 577/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:40 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:42.089487 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:42.090098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:42.097793 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:42.098881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:42.099692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:42.100122 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:42.250851 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:42.260305 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-566ebc21-208e-4d55-b234-e873615fa614 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.174823 May 27 20:00:42.261383 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 521/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:42 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:42.400754 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-cb172170-3bb7-4769-8bcd-862511034c72 req-3bfdd434-7413-4863-987b-f65c83410782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d", "tag": "ea26e901-697c-45c5-aa12-fc8fb0cfaf40"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:42.412578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-cb172170-3bb7-4769-8bcd-862511034c72 req-3bfdd434-7413-4863-987b-f65c83410782 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:42.412578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-cb172170-3bb7-4769-8bcd-862511034c72 req-3bfdd434-7413-4863-987b-f65c83410782 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:42.420627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-cb172170-3bb7-4769-8bcd-862511034c72 req-3bfdd434-7413-4863-987b-f65c83410782 service nova] Creating event network-changed:ea26e901-697c-45c5-aa12-fc8fb0cfaf40 for instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d on hv-cinder-83979 May 27 20:00:42.426650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-cb172170-3bb7-4769-8bcd-862511034c72 req-3bfdd434-7413-4863-987b-f65c83410782 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029550 May 27 20:00:42.427263 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 578/1099] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:00:43.278015 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:43.278653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:43.286101 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:43.286550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:43.287648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:43.287814 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:43.422467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:43.430689 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b6d90b43-f717-4c12-849d-a83786ad8e6d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.156380 May 27 20:00:43.431290 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 522/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:43 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:44.449349 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:44.450043 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:44.456563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:44.457042 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:44.457796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:44.458228 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:44.588809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:44.596845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-05211b26-59af-4cb1-a536-172a0bd02dd7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.152188 May 27 20:00:44.597444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 579/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:44 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:45.613781 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:45.614317 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:45.621073 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:45.621522 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:45.622287 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:45.622715 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:45.760458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:45.767826 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-63f8ca13-18e0-48da-88f9-7d05dfd61baf tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.158028 May 27 20:00:45.768396 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 523/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:45 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:46.784740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:46.785408 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:46.791830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:46.792279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:46.793068 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:46.793505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:46.920819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:46.928853 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-40165a4d-dede-4656-afde-5d293b7d5f4f tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.148011 May 27 20:00:46.929453 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 580/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:46 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:47.715002 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-454726cd-6bbe-42c8-b20a-2cca92c0342f req-0cadb7d0-b168-4197-a153-77d710beeb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d", "name": "network-vif-plugged", "status": "completed", "tag": "ea26e901-697c-45c5-aa12-fc8fb0cfaf40"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:47.724054 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-454726cd-6bbe-42c8-b20a-2cca92c0342f req-0cadb7d0-b168-4197-a153-77d710beeb97 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:47.724570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-454726cd-6bbe-42c8-b20a-2cca92c0342f req-0cadb7d0-b168-4197-a153-77d710beeb97 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:47.737859 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-454726cd-6bbe-42c8-b20a-2cca92c0342f req-0cadb7d0-b168-4197-a153-77d710beeb97 service nova] Creating event network-vif-plugged:ea26e901-697c-45c5-aa12-fc8fb0cfaf40 for instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d on hv-cinder-83979 May 27 20:00:47.743711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-454726cd-6bbe-42c8-b20a-2cca92c0342f req-0cadb7d0-b168-4197-a153-77d710beeb97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 May 27 20:00:47.744288 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 524/1104] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:00:47.945670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:47.946278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:47.952982 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:47.953440 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:47.954196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:47.954631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:48.135549 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:48.142946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-84aea335-8408-471e-bf19-be0b4ad5ec28 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.201161 May 27 20:00:48.143494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 581/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:47 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:49.162044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:49.162044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:49.162611 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:49.162798 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:49.168906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:49.169458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:49.170225 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:49.170657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:49.304308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:49.311729 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e4864aa6-1740-4a4d-8d75-8126bb22e3fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1362 microversion: 2.1 time: 0.155857 May 27 20:00:49.313059 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 525/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:49 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:50.329353 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:50.329957 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:50.331883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:50.337994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:50.338439 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:50.340301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:50.340301 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:50.471034 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:00:50.478822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d2b5b13f-4184-4c4e-86c4-fd3d1db973fc tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1549 microversion: 2.1 time: 0.153454 May 27 20:00:50.479385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 582/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:00:50 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:00:50.495152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:00:50.495668 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:00:50.502023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:50.502466 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:50.503221 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:50.503647 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:50.580918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-987d6de3-fc57-466a-9d4a-451188842bcd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089436 May 27 20:00:50.581564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 526/1108] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 20:00:50 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:00:51.538491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-aab80110-06c8-481f-95cb-da44d472d818 req-82f85103-16e4-44e8-8aaf-414ea564ed64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d", "tag": "ea26e901-697c-45c5-aa12-fc8fb0cfaf40"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:00:51.547251 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-aab80110-06c8-481f-95cb-da44d472d818 req-82f85103-16e4-44e8-8aaf-414ea564ed64 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:00:51.547689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-aab80110-06c8-481f-95cb-da44d472d818 req-82f85103-16e4-44e8-8aaf-414ea564ed64 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:00:51.558990 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-aab80110-06c8-481f-95cb-da44d472d818 req-82f85103-16e4-44e8-8aaf-414ea564ed64 service nova] Creating event network-changed:ea26e901-697c-45c5-aa12-fc8fb0cfaf40 for instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d on hv-cinder-83979 May 27 20:00:51.564012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-aab80110-06c8-481f-95cb-da44d472d818 req-82f85103-16e4-44e8-8aaf-414ea564ed64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029759 May 27 20:00:51.565245 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 583/1109] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:20.766782 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:20.767546 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:20.771570 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:20.772057 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:20.778711 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:20.781998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:20.781998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:20.781998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:20.805874 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-780251c6-1a79-46da-ab05-2e42d5b361d3 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/ips" status: 200 len: 146 microversion: 2.1 time: 0.040492 May 27 20:01:20.808458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 527/1110] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 20:01:20 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:22.370017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.370767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=54 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.375007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a83019bb-8b8a-4e3e-84c4-022da154fce8"}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:01:22.379100 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:22.382260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:22.383206 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:22.383967 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:22.384403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:23.068878 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-baac2145-b9aa-45d3-9a93-d970e0e281ac tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700118 May 27 20:01:23.069586 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 584/1111] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 20:01:22 2022] POST /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:30.563990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:30.564912 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:30.572419 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:30.572865 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:30.573653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:30.574075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:30.603901 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-58e3d954-99c3-4b0b-85d8-becf187da9f7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 May 27 20:01:30.604452 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 528/1112] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 20:01:30 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:01:30.615174 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:30.615762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:30.622346 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:30.622796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:30.623560 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:30.623993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:30.653146 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4b2d0ebd-b40c-4cdf-b027-ec22b668e6d7 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8" status: 200 len: 194 microversion: 2.1 time: 0.042641 May 27 20:01:30.653756 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 585/1113] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 20:01:30 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:32.231223 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8ce0c47-8132-4417-b4cf-f9bdccd1163a"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:01:32.232285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:32.239429 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:32.239887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:32.240655 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:32.241136 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:32.928648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-dc2c7dc2-8c27-4073-b60d-152984fe941d tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "POST /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702276 May 27 20:01:32.929284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 529/1114] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 20:01:32 2022] POST /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:40.415175 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:40.416248 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:40.423045 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.423469 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.424236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.424667 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.455995 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a99e96db-d5ea-4cff-8af0-e2ef247cb741 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045253 May 27 20:01:40.456540 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 586/1115] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 20:01:40 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:40.595503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:40.596023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:40.603410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.603850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.604606 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.605067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.632672 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-901f094b-e749-4735-a284-49c54afd1517 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8" status: 200 len: 194 microversion: 2.1 time: 0.042094 May 27 20:01:40.633624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 530/1116] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 20:01:40 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:40.642939 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:40.643427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:40.649946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.650461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.651224 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:40.651659 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:40.732477 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lazy-loading 'services' on Instance uuid c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:01:40.953579 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f55ca351-7b0d-41a6-ba84-02c5c479d92e tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8" status: 202 len: 0 microversion: 2.1 time: 0.314306 May 27 20:01:40.954206 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 587/1117] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 20:01:40 2022] DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/a83019bb-8b8a-4e3e-84c4-022da154fce8 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:01:42.073266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:42.078631 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:42.080707 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:42.081208 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:42.081973 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:42.082394 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:42.112653 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6818e12d-1ee9-4224-a920-4a832f17749b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/d8ce0c47-8132-4417-b4cf-f9bdccd1163a" status: 200 len: 194 microversion: 2.1 time: 0.044691 May 27 20:01:42.113257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 531/1118] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 20:01:42 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/d8ce0c47-8132-4417-b4cf-f9bdccd1163a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:42.123801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:42.124836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:42.131213 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:42.131670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:42.132410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:42.132842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:42.213242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lazy-loading 'services' on Instance uuid c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:01:42.417202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-dbcbff78-6797-41b6-880c-dbaae66cfe13 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/d8ce0c47-8132-4417-b4cf-f9bdccd1163a" status: 202 len: 0 microversion: 2.1 time: 0.297426 May 27 20:01:42.417793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 588/1119] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 20:01:42 2022] DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments/d8ce0c47-8132-4417-b4cf-f9bdccd1163a => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:01:43.579530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:43.580511 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:43.588329 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.588775 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.589562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.589990 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.618584 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e589afe2-dd30-49f8-9464-b3a7bab6dafd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042881 May 27 20:01:43.619138 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 532/1120] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 20:01:43 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 20:01:43.734971 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:43.735960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:43.742376 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.742928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.743989 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.744622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.772832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9c75e683-e625-44fc-8168-7c0fccd1b1d8 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042607 May 27 20:01:43.773428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 589/1121] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 20:01:43 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 20:01:43.831690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:43.832178 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:43.838993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.839439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.840187 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:43.840617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:43.865743 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:01:44.106966 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3f29ff9a-f4c1-43ff-95d8-a46038940e11 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 204 len: 0 microversion: 2.1 time: 0.278818 May 27 20:01:44.107469 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 533/1122] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:01:43 2022] DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:01:44.115509 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:44.116131 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:44.122185 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:44.122627 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:44.123373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:44.123801 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:44.252145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:01:44.260208 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-33d5cdec-d11d-42f0-ad5b-76bcda53a7fd tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1673 microversion: 2.1 time: 0.148437 May 27 20:01:44.260767 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 590/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:44 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:01:45.278697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:45.279404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:45.286001 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:45.288654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:45.288654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:45.288654 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:45.418199 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:01:45.425617 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a43d60a2-fd13-489a-abf0-ce86cef7e68b tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1673 microversion: 2.1 time: 0.151947 May 27 20:01:45.426172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 534/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:45 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:01:46.443700 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:46.444314 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:46.451187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:46.451631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:46.452396 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:46.452831 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:46.625466 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:01:46.633170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4d14a79c-6a6d-4799-be0a-4fd1078d3e29 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1673 microversion: 2.1 time: 0.193290 May 27 20:01:46.633682 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 591/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:46 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:01:47.236339 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-0ea3ee57-81e6-4970-8f05-602ca813d26c req-259474bd-5503-4f44-aad3-151f3b400e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d", "name": "network-vif-deleted", "tag": "ea26e901-697c-45c5-aa12-fc8fb0cfaf40"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:01:47.244435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0ea3ee57-81e6-4970-8f05-602ca813d26c req-259474bd-5503-4f44-aad3-151f3b400e04 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:47.244881 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-0ea3ee57-81e6-4970-8f05-602ca813d26c req-259474bd-5503-4f44-aad3-151f3b400e04 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:47.255903 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-0ea3ee57-81e6-4970-8f05-602ca813d26c req-259474bd-5503-4f44-aad3-151f3b400e04 service nova] Creating event network-vif-deleted:ea26e901-697c-45c5-aa12-fc8fb0cfaf40 for instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d on hv-cinder-83979 May 27 20:01:47.261458 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-0ea3ee57-81e6-4970-8f05-602ca813d26c req-259474bd-5503-4f44-aad3-151f3b400e04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301290 May 27 20:01:47.269283 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 535/1126] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:01:47.650607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:47.651277 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:47.657872 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:47.658395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:47.659165 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:47.659609 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:47.693954 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:47.694409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:47.694869 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lazy-loading 'fault' on Instance uuid c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:01:47.739216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcdd3f30e42b41308b69e1233686cc17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d8222fe16e403999de6fc5803b50d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:01:47.747793 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-95c51c66-40b5-43b5-b670-78e6ec12c668 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 200 len: 1327 microversion: 2.1 time: 0.101112 May 27 20:01:47.748367 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 592/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:47 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:01:48.766648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:48.767342 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:48.773720 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:48.774792 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:48.775554 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:48.775984 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:48.789077 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d HTTP/1.1 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 20:01:48.790896 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:48.792616 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d'} May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:01:48.793621 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:48.795351 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:48.796887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:01:48.796887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3339ec17-eaa1-4d5b-bb5a-add25a822a56 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 404 len: 111 microversion: 2.1 time: 0.030434 May 27 20:01:48.796887 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 536/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:48 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:01:48.801124 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-f5192099-0f98-46f3-a0a1-90dc7f983bae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '.version_select at 0x7fe1b47c6ee0>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:48.892285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-f5192099-0f98-46f3-a0a1-90dc7f983bae tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521206678" status: 202 len: 0 microversion: 2.1 time: 0.094934 May 27 20:01:48.892882 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 593/1129] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 20:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521206678 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:01:52.162269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:52.162769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:52.169289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:52.169737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:52.170523 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:52.170953 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:52.184548 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d HTTP/1.1 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 20:01:52.186086 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.187717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': 'c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d'} May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:01:52.188656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.190296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:52.191979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:01:52.191979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9b21f7d1-80a7-423c-b5ab-8292299057a5 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 404 len: 111 microversion: 2.1 time: 0.029005 May 27 20:01:52.191979 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 537/1130] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:01:52 2022] DELETE /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:01:52.196258 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:52.196867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:52.204036 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:52.204484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:52.205292 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:52.205723 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:52.220291 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d HTTP/1.1 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:01:52.221960 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.223595 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d'} May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:01:52.224527 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. May 27 20:01:52.226163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:52.227536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:01:52.227536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-a0608b46-66e9-49c7-b677-bb8057976455 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d" status: 404 len: 111 microversion: 2.1 time: 0.031517 May 27 20:01:52.227536 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 594/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:52 2022] GET /compute/v2.1/servers/c0a6d97c-001f-4ec2-9d5c-6801cf6eed5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:01:53.562769 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:53.563284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:53.569690 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:53.570142 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:53.570910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:53.571347 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:53.585531 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b HTTP/1.1 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 20:01:53.587033 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.589628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '1cce55b5-d6fd-4066-a3e5-79728532f74b'} May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:01:53.590839 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.592467 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:01:53.594133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:01:53.594133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-862d6b26-ae33-49f4-8de1-9568ac716718 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 404 len: 111 microversion: 2.1 time: 0.029454 May 27 20:01:53.594133 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 538/1132] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:01:53 2022] DELETE /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:01:53.599369 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:01:53.599984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] [instance: 1cce55b5-d6fd-4066-a3e5-79728532f74b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:01:53.602396 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:53.607541 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:53.607994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:53.608769 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:01:53.609239 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:01:53.613163 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:53.623211 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] HTTP exception thrown: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Request method failure captured: May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b HTTP/1.1 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS0_EtGohpzWj-jFWPIqXhcRyP_D8JKuBo5gIJ1gOYA3SyCId4cFTxX4PYGhd3f9atpqjzfxe5tATiUhuBaWBZGyoTxdoCyGqjYgI-0Edl93LmjA5Mbl5AuvY-HfRq0PhS6K44935rTYwVs6QIwmmlEbxCaXc2JqlFYWXTBVqWpOsv4 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:01:53.624720 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/51d8222fe16e403999de6fc5803b50d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_51d8222fe16e403999de6fc5803b50d3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/51d8222fe16e403999de6fc5803b50d3"}]}] May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 51d8222fe16e403999de6fc5803b50d3 May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905902366 May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: bcdd3f30e42b41308b69e1233686cc17 May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-AttachVolumeTestJSON-905902366-project May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.626402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '1cce55b5-d6fd-4066-a3e5-79728532f74b'} May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:01:53.627390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. May 27 20:01:53.628897 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:01:53.630310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] Returning 404 to user: Instance 1cce55b5-d6fd-4066-a3e5-79728532f74b could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:01:53.630310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-770db3c7-babd-4132-9604-96d9371b9636 tempest-AttachVolumeTestJSON-905902366 tempest-AttachVolumeTestJSON-905902366-project] 10.222.0.13 "GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b" status: 404 len: 111 microversion: 2.1 time: 0.030643 May 27 20:01:53.630310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 595/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:01:53 2022] GET /compute/v2.1/servers/1cce55b5-d6fd-4066-a3e5-79728532f74b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:02:28.188646 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-856676284", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "networks": [{"uuid": "a5010572-721c-41d2-813f-e5cef97f21a9"}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:02:28.195768 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:28.196420 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:28.242862 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] validate_networks() for [('a5010572-721c-41d2-813f-e5cef97f21a9', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:02:28.589814 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:02:28.590236 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:02:28.590709 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:02:28.591334 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:02:28.591756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:02:28.600733 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:28.601162 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:28.601958 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:28.602390 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:28.619600 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Getting quotas for project 0899ff6998fc48d6a83240edb7f27a70. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:02:28.624286 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Getting quotas for user d6561b445d3748b8ab088468d9ffe019 and project 0899ff6998fc48d6a83240edb7f27a70. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:02:28.635039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:02:28.637282 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:02:28.736036 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3ea8b2d5-942c-4ba2-b869-2282d393540b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551735 May 27 20:02:28.736676 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 539/1134] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 20:02:28.747260 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-806ddae2-1a82-4a91-8968-ec8c2552af6c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:28.747970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-806ddae2-1a82-4a91-8968-ec8c2552af6c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:28.803652 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-806ddae2-1a82-4a91-8968-ec8c2552af6c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:28.810722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-806ddae2-1a82-4a91-8968-ec8c2552af6c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1218 microversion: 2.1 time: 0.068079 May 27 20:02:28.811282 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 596/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:28 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:29.829368 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:29.830004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:29.837435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:29.837884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:29.838661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:29.839098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:29.899807 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:29.907854 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-9bd0f498-3c36-4f1b-92b2-0382d5d79f8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1222 microversion: 2.1 time: 0.083784 May 27 20:02:29.908411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 540/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:29 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:30.924207 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:30.924820 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:30.934196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:30.935134 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:30.936029 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:30.936471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:31.001563 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:31.009286 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ccb2ba9b-79e7-402a-8538-88e56b5083ee tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1288 microversion: 2.1 time: 0.089395 May 27 20:02:31.009857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 597/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:30 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:32.027629 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:32.028831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:32.036115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:32.036562 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:32.037386 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:32.037817 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:32.181218 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:32.188026 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bce77ee5-af4e-47bc-9a19-3b2f6f44cb85 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.164815 May 27 20:02:32.188845 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 541/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:32 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:32.358910 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-a5392ce6-7b97-4632-b1d1-610304af8000 req-8076bf18-2bf6-44fd-8baf-26c7f4f24bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6936df41-345c-4349-8a47-518c87bff30a", "tag": "6ba040fc-fac3-45ce-9fa6-9cee8f8cb526"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:02:32.372867 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a5392ce6-7b97-4632-b1d1-610304af8000 req-8076bf18-2bf6-44fd-8baf-26c7f4f24bcc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:32.373399 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-a5392ce6-7b97-4632-b1d1-610304af8000 req-8076bf18-2bf6-44fd-8baf-26c7f4f24bcc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:32.384673 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-a5392ce6-7b97-4632-b1d1-610304af8000 req-8076bf18-2bf6-44fd-8baf-26c7f4f24bcc service nova] Creating event network-changed:6ba040fc-fac3-45ce-9fa6-9cee8f8cb526 for instance 6936df41-345c-4349-8a47-518c87bff30a on hv-cinder-83979 May 27 20:02:32.391492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-a5392ce6-7b97-4632-b1d1-610304af8000 req-8076bf18-2bf6-44fd-8baf-26c7f4f24bcc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044632 May 27 20:02:32.392095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 598/1139] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:02:33.205485 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:33.206139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:33.212597 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:33.213071 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:33.213834 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:33.214263 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:33.347510 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:33.355006 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fe43d35a-9a50-4d8f-8db0-400cf0f542ae tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.153424 May 27 20:02:33.355564 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 542/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:33 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:34.372921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:34.373644 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:34.380467 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:34.380919 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:34.381706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:34.382141 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:34.507887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:34.515943 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-70063a04-3c73-427d-96c4-316511b0610b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.147441 May 27 20:02:34.516491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 599/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:34 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:35.532923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:35.533556 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:35.539988 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:35.540435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:35.541245 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:35.541684 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:35.667100 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:35.675297 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-fceeca9d-44dd-426b-8e75-0626300cbf8c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.146217 May 27 20:02:35.675866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 543/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:35 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:36.691575 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:36.692204 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:36.698862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:36.699302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:36.700909 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:36.701366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:36.830608 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:36.837955 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-41db28e6-dd66-4e7e-8745-e0bc62c5d041 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.150242 May 27 20:02:36.838514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 600/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:36 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:37.854942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:37.855494 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:37.861648 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:37.862092 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:37.862842 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:37.863269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:37.994699 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:38.002265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bad2abcf-7918-4c73-bb39-661ff710ef6a tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.151387 May 27 20:02:38.009313 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 544/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:37 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:38.336864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1d3f9c63-5b30-4d63-8ade-42a48911824a req-b6011804-2a2c-4d49-a696-9fe8150987d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6936df41-345c-4349-8a47-518c87bff30a", "name": "network-vif-plugged", "status": "completed", "tag": "6ba040fc-fac3-45ce-9fa6-9cee8f8cb526"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:02:38.350288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1d3f9c63-5b30-4d63-8ade-42a48911824a req-b6011804-2a2c-4d49-a696-9fe8150987d7 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:38.350288 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1d3f9c63-5b30-4d63-8ade-42a48911824a req-b6011804-2a2c-4d49-a696-9fe8150987d7 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:38.356883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1d3f9c63-5b30-4d63-8ade-42a48911824a req-b6011804-2a2c-4d49-a696-9fe8150987d7 service nova] Creating event network-vif-plugged:6ba040fc-fac3-45ce-9fa6-9cee8f8cb526 for instance 6936df41-345c-4349-8a47-518c87bff30a on hv-cinder-83979 May 27 20:02:38.361902 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1d3f9c63-5b30-4d63-8ade-42a48911824a req-b6011804-2a2c-4d49-a696-9fe8150987d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155166 May 27 20:02:38.362488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 601/1145] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:02:39.019459 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:39.020116 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:39.021965 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:39.022613 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:39.028160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:39.028656 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:39.029454 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:39.029888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:39.157367 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:39.164681 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-a08ff2e5-9a63-4a1d-a862-13c3675d2f71 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1318 microversion: 2.1 time: 0.149163 May 27 20:02:39.165264 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 545/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:39 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:40.179105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:40.183815 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:02:40.184798 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:40.191035 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:40.191927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:40.192394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:40.192828 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:40.320832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:02:40.329295 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-442c8d99-cf07-441d-846d-f6a6763b0967 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1507 microversion: 2.1 time: 0.151144 May 27 20:02:40.329888 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 602/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:02:40 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:02:55.676697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce26fa21-80b1-4947-bb12-2cf1f7526ab7", "device": "/dev/sdb"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:02:55.678370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:02:55.680701 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:55.681478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=38 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:55.686269 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:55.686718 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:55.687478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:02:55.687918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:02:56.478759 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d9eabd28-feb1-4529-a3ca-fd5e99fee779 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "POST /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806695 May 27 20:02:56.484493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 546/1148] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 20:02:55 2022] POST /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:03:21.033568 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:21.034726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:21.036726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=17 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:21.037466 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=29 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:21.042213 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:21.042657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:21.043450 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:21.043842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:21.127378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lazy-loading 'services' on Instance uuid 6936df41-345c-4349-8a47-518c87bff30a {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:03:21.372926 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-66e7174f-dd83-4f24-995e-7bbc4ecba0ac tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a/os-volume_attachments/ce26fa21-80b1-4947-bb12-2cf1f7526ab7" status: 202 len: 0 microversion: 2.1 time: 0.343006 May 27 20:03:21.373852 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 603/1149] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 20:03:21 2022] DELETE /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a/os-volume_attachments/ce26fa21-80b1-4947-bb12-2cf1f7526ab7 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:03:22.489998 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:22.490758 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:22.494779 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:22.495382 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:22.501496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:22.502127 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:22.502889 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:22.503319 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:22.529317 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:03:22.819997 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-889606e7-cb1c-45be-971d-0351d23d69ea tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 204 len: 0 microversion: 2.1 time: 0.331536 May 27 20:03:22.820592 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 547/1150] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:03:22 2022] DELETE /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:03:22.830041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:22.830778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:22.837690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:22.838132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:22.838883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:22.839310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:22.971520 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:22.979052 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-333525e8-257a-4c0a-8f9e-97099343333b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1513 microversion: 2.1 time: 0.153638 May 27 20:03:22.979599 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 604/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:22 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:03:23.996943 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:23.997669 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:24.004089 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:24.004545 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:24.006309 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:24.006753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:24.138995 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:24.146488 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f9d11ac6-35e1-4b1c-93cf-41807d5fd2ca tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1513 microversion: 2.1 time: 0.153751 May 27 20:03:24.147190 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 548/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:23 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:03:24.912764 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-b73fff62-7b61-4a2a-82b4-c60863d546b6 req-7aa47aae-0ae3-4614-883e-ebf6920db11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6936df41-345c-4349-8a47-518c87bff30a", "name": "network-vif-deleted", "tag": "6ba040fc-fac3-45ce-9fa6-9cee8f8cb526"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:03:24.921273 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b73fff62-7b61-4a2a-82b4-c60863d546b6 req-7aa47aae-0ae3-4614-883e-ebf6920db11a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:24.921714 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b73fff62-7b61-4a2a-82b4-c60863d546b6 req-7aa47aae-0ae3-4614-883e-ebf6920db11a service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:24.932964 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-b73fff62-7b61-4a2a-82b4-c60863d546b6 req-7aa47aae-0ae3-4614-883e-ebf6920db11a service nova] Creating event network-vif-deleted:6ba040fc-fac3-45ce-9fa6-9cee8f8cb526 for instance 6936df41-345c-4349-8a47-518c87bff30a on hv-cinder-83979 May 27 20:03:24.937907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-b73fff62-7b61-4a2a-82b4-c60863d546b6 req-7aa47aae-0ae3-4614-883e-ebf6920db11a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029673 May 27 20:03:24.938542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 605/1153] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:03:25.164135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:25.164744 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:25.171311 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:25.171879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:25.172640 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:25.173107 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:25.237291 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:25.244910 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bf85f9f6-ff56-4f33-a069-0f8a44238d5e tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 200 len: 1303 microversion: 2.1 time: 0.085414 May 27 20:03:25.245493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 549/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:25 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:26.263144 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:26.263921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 6936df41-345c-4349-8a47-518c87bff30a] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:26.270168 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:26.270778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:26.271525 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:26.271961 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:26.284823 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] HTTP exception thrown: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Request method failure captured: May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a HTTP/1.1 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS5S5E6nRbpi13eFNY6nduV3q_uh7z7Xbd8Y_c6l1MraHXuH8spOWLKHk8tnEzQa3FWX6mqhGr-1H61OUChtscDPn016NIgyEt8qKxVpgoLG3Pk297atQqI5K1kzZaHpq2_m9VH3ntdMI1r54MYi9zVxGaphDQpkNi9lVoSa8FG1AgM May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 0899ff6998fc48d6a83240edb7f27a70 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:03:26.290471 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0899ff6998fc48d6a83240edb7f27a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0899ff6998fc48d6a83240edb7f27a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0899ff6998fc48d6a83240edb7f27a70", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0899ff6998fc48d6a83240edb7f27a70"}]}] May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 0899ff6998fc48d6a83240edb7f27a70 May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesSnapshotTestJSON-1399457027-project May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: d6561b445d3748b8ab088468d9ffe019 May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesSnapshotTestJSON-1399457027-project May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. May 27 20:03:26.292196 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '6936df41-345c-4349-8a47-518c87bff30a'} May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:03:26.293259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. May 27 20:03:26.295278 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:03:26.296730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Returning 404 to user: Instance 6936df41-345c-4349-8a47-518c87bff30a could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:03:26.296730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8966bc15-963e-4d06-af20-381b4036638d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a" status: 404 len: 111 microversion: 2.1 time: 0.030020 May 27 20:03:26.296730 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 606/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:26 2022] GET /compute/v2.1/servers/6936df41-345c-4349-8a47-518c87bff30a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:03:34.658122 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1254028183", "imageRef": "20d98c03-721d-4999-934f-aeab17c77f61", "flavorRef": "452", "networks": [{"uuid": "a5010572-721c-41d2-813f-e5cef97f21a9"}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:03:34.714254 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] validate_networks() for [('a5010572-721c-41d2-813f-e5cef97f21a9', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:03:35.072274 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:03:35.072788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:03:35.073222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:03:35.073628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:03:35.074035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:03:35.082882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:35.083321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:35.084112 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:35.084593 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:35.101353 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Getting quotas for project 0899ff6998fc48d6a83240edb7f27a70. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:03:35.105278 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Getting quotas for user d6561b445d3748b8ab088468d9ffe019 and project 0899ff6998fc48d6a83240edb7f27a70. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:03:35.116857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:03:35.119135 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='20d98c03-721d-4999-934f-aeab17c77f61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:03:35.267173 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8ee683d0-8a67-47dd-b7dd-bf5e913e8da7 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612892 May 27 20:03:35.267823 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 550/1156] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:03:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 20:03:35.277778 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d828b8c7-3f14-4445-9dfd-25d837e93515 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:35.278388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d828b8c7-3f14-4445-9dfd-25d837e93515 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:35.333745 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d828b8c7-3f14-4445-9dfd-25d837e93515 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:35.341555 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d828b8c7-3f14-4445-9dfd-25d837e93515 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1219 microversion: 2.1 time: 0.067643 May 27 20:03:35.342115 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 607/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:35 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:36.358756 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-509324ea-3f97-4d7f-a394-a1974eb61f65 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:36.359355 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-509324ea-3f97-4d7f-a394-a1974eb61f65 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:36.412539 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-509324ea-3f97-4d7f-a394-a1974eb61f65 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:36.419265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-509324ea-3f97-4d7f-a394-a1974eb61f65 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1219 microversion: 2.1 time: 0.064767 May 27 20:03:36.419819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 551/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:36 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:37.435569 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ea34b28d-0c1f-4591-be8a-5a2fe0fc0c3b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:37.436172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ea34b28d-0c1f-4591-be8a-5a2fe0fc0c3b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:37.438105 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:37.490317 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ea34b28d-0c1f-4591-be8a-5a2fe0fc0c3b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:37.498048 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ea34b28d-0c1f-4591-be8a-5a2fe0fc0c3b tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1219 microversion: 2.1 time: 0.066243 May 27 20:03:37.498610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 608/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:37 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:38.515787 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c8e48c85-6f7a-400b-b0f2-60a9f1038d2d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:38.516425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c8e48c85-6f7a-400b-b0f2-60a9f1038d2d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:38.568040 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c8e48c85-6f7a-400b-b0f2-60a9f1038d2d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:38.575496 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c8e48c85-6f7a-400b-b0f2-60a9f1038d2d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1219 microversion: 2.1 time: 0.063828 May 27 20:03:38.576055 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 552/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:38 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:39.592813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:39.593444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:39.599573 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:39.600145 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:39.601064 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:39.601452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:39.659891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:39.667263 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e06a8098-fa33-4dc5-8ecc-d17d5ac56587 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1223 microversion: 2.1 time: 0.078857 May 27 20:03:39.667826 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 609/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:39 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:40.684318 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:40.684907 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:40.692088 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:40.692541 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:40.693328 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:40.693764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:40.758306 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:40.766081 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f8e573df-44c7-4f18-a367-6235f6238c22 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1271 microversion: 2.1 time: 0.085552 May 27 20:03:40.766642 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 553/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:40 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:41.783746 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:41.784350 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:41.791925 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:41.792372 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:41.793155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:41.793583 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:41.931431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:41.938945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-20fde646-0d99-44b0-b386-68c3e0b1dcb1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.159125 May 27 20:03:41.939512 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 610/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:41 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:42.891239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-afda7a31-2b8c-4ccb-9219-db4fe7da639d req-30419c77-5db4-4d81-a702-0b8d6d728022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22eb350a-5651-431a-8e80-1d0200d94342", "tag": "994bc5f2-431c-465b-a5ed-75b5461393bf"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:03:42.900043 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-afda7a31-2b8c-4ccb-9219-db4fe7da639d req-30419c77-5db4-4d81-a702-0b8d6d728022 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:42.902398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-afda7a31-2b8c-4ccb-9219-db4fe7da639d req-30419c77-5db4-4d81-a702-0b8d6d728022 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:42.912016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-afda7a31-2b8c-4ccb-9219-db4fe7da639d req-30419c77-5db4-4d81-a702-0b8d6d728022 service nova] Creating event network-changed:994bc5f2-431c-465b-a5ed-75b5461393bf for instance 22eb350a-5651-431a-8e80-1d0200d94342 on hv-cinder-83979 May 27 20:03:42.917517 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-afda7a31-2b8c-4ccb-9219-db4fe7da639d req-30419c77-5db4-4d81-a702-0b8d6d728022 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029950 May 27 20:03:42.918112 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 554/1164] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:03:42.955832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:42.956425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:42.963099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:42.963541 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:42.964323 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:42.964732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:43.205425 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:43.213489 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e5bf390b-e76d-4101-a489-372cf7514a52 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.261803 May 27 20:03:43.214062 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 611/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:42 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:44.230326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:44.231023 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:44.237246 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:44.237688 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:44.238448 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:44.238882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:44.369340 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:44.377791 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3ef01b75-b16a-4f01-8fd6-863fdfe294d9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.152084 May 27 20:03:44.378359 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 555/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:44 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:45.265285 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:03:45.265983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:03:45.394657 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:45.395246 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:45.402442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:45.402891 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:45.403650 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:45.404084 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:45.534120 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:45.542021 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-038da254-0092-44a0-8d5e-8ec82b36070d tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.151373 May 27 20:03:45.542590 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 612/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:45 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:46.559450 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:46.560058 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:46.561940 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:46.567231 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:46.573445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:46.573445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:46.573445 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:46.700395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:46.707964 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-341dc218-021d-4466-8256-3694f281f9e8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.152990 May 27 20:03:46.708520 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 556/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:46 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:47.724028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:47.724634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:47.726928 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=4 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:47.731762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:47.732203 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:47.732975 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:47.733413 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:47.861726 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:47.869811 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-36ff939b-92a1-4222-97fe-d7178ef647a8 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.149624 May 27 20:03:47.870372 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 613/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:47 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:48.522802 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-4d92343a-0143-480a-b502-720019449711 req-b46ff368-3bc2-47c7-9eb2-4cfb615d297b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eb350a-5651-431a-8e80-1d0200d94342", "name": "network-vif-plugged", "status": "completed", "tag": "994bc5f2-431c-465b-a5ed-75b5461393bf"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:03:48.532575 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4d92343a-0143-480a-b502-720019449711 req-b46ff368-3bc2-47c7-9eb2-4cfb615d297b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:48.533129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4d92343a-0143-480a-b502-720019449711 req-b46ff368-3bc2-47c7-9eb2-4cfb615d297b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:48.544425 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-4d92343a-0143-480a-b502-720019449711 req-b46ff368-3bc2-47c7-9eb2-4cfb615d297b service nova] Creating event network-vif-plugged:994bc5f2-431c-465b-a5ed-75b5461393bf for instance 22eb350a-5651-431a-8e80-1d0200d94342 on hv-cinder-83979 May 27 20:03:48.549721 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-4d92343a-0143-480a-b502-720019449711 req-b46ff368-3bc2-47c7-9eb2-4cfb615d297b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 May 27 20:03:48.562009 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 557/1170] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:03:48.886542 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:48.887182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:48.893895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:48.894626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:48.895167 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:48.895594 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:49.026426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:49.033886 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-84f6cd7c-e8e3-4893-9064-08a227e9db82 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.151941 May 27 20:03:49.034444 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 614/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:48 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:50.050389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:50.051083 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:50.052991 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=10 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:50.058623 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:50.059063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:50.059819 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:50.060247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:50.196889 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:50.204589 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4bdad6b5-0472-4b93-911e-6330b4703ef9 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1319 microversion: 2.1 time: 0.158130 May 27 20:03:50.205172 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 558/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:50 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:51.222385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:03:51.223086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:51.225379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=29 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:51.230365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:51.233830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:51.233830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:51.233830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:51.362184 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:03:51.369610 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d5da63b9-c160-46fb-81df-ca52b90cc00c tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1507 microversion: 2.1 time: 0.151062 May 27 20:03:51.370744 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 615/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:03:51 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:03:51.386942 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d01fba90-bba7-4b6c-a205-008627fafc0a", "device": "/dev/sdb"}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:03:51.388060 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:03:51.394512 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:51.395724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:51.396580 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:03:51.397061 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:03:52.096418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c72a45b5-b3d6-49f8-9d2b-b2d55222dc42 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "POST /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713483 May 27 20:03:52.097080 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 559/1174] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 20:03:51 2022] POST /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:03:54.277842 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:03:54.278545 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:03:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:04:12.044616 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:12.045254 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:12.047840 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:12.048484 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=42 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:12.053187 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:12.053631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:12.054378 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:12.054809 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:12.134940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lazy-loading 'services' on Instance uuid 22eb350a-5651-431a-8e80-1d0200d94342 {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:04:12.351701 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-e88895a1-0a80-4f39-89f7-d14679376b48 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342/os-volume_attachments/d01fba90-bba7-4b6c-a205-008627fafc0a" status: 202 len: 0 microversion: 2.1 time: 0.310731 May 27 20:04:12.352256 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 616/1175] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 20:04:12 2022] DELETE /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342/os-volume_attachments/d01fba90-bba7-4b6c-a205-008627fafc0a => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:04:13.463470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:13.468165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:13.468165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:13.468165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:13.472357 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:13.472805 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:13.473721 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:13.474152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:13.499618 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:04:13.849599 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-09f89068-09ca-4a5a-8a99-938d03e6e1de tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "DELETE /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 204 len: 0 microversion: 2.1 time: 0.389891 May 27 20:04:13.850109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 560/1176] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:04:13 2022] DELETE /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:04:13.859237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:13.864510 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:13.866740 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:13.867183 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:13.867940 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:13.868365 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:13.997618 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:04:14.005294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1d36b6ce-8457-45d5-98a3-07f290a134db tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1513 microversion: 2.1 time: 0.150816 May 27 20:04:14.005874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 617/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:04:13 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:04:15.023731 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:15.024463 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:15.032134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:15.032676 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:15.034160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:15.034595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:15.165267 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:04:15.172873 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-2f38b555-f800-4137-b36e-96736b6ecbf1 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1513 microversion: 2.1 time: 0.153459 May 27 20:04:15.173526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 561/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:04:15 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:04:15.871132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-c49c2db2-4b8f-4aad-a09e-c31b022f0562 req-6f619ff0-1149-4346-89d6-c5c15c4e5b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22eb350a-5651-431a-8e80-1d0200d94342", "name": "network-vif-deleted", "tag": "994bc5f2-431c-465b-a5ed-75b5461393bf"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:04:15.880413 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-c49c2db2-4b8f-4aad-a09e-c31b022f0562 req-6f619ff0-1149-4346-89d6-c5c15c4e5b86 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:15.880849 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-c49c2db2-4b8f-4aad-a09e-c31b022f0562 req-6f619ff0-1149-4346-89d6-c5c15c4e5b86 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:15.891499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-c49c2db2-4b8f-4aad-a09e-c31b022f0562 req-6f619ff0-1149-4346-89d6-c5c15c4e5b86 service nova] Creating event network-vif-deleted:994bc5f2-431c-465b-a5ed-75b5461393bf for instance 22eb350a-5651-431a-8e80-1d0200d94342 on hv-cinder-83979 May 27 20:04:15.896777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-c49c2db2-4b8f-4aad-a09e-c31b022f0562 req-6f619ff0-1149-4346-89d6-c5c15c4e5b86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029401 May 27 20:04:15.897390 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 618/1179] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:04:16.189453 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:16.190126 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:16.196490 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:16.196931 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:16.197722 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:16.198156 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:16.231730 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:16.232202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:16.232641 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.objects.instance [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lazy-loading 'fault' on Instance uuid 22eb350a-5651-431a-8e80-1d0200d94342 {{(pid=124678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:04:16.273310 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6561b445d3748b8ab088468d9ffe019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899ff6998fc48d6a83240edb7f27a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:04:16.280703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f84639ba-fc1e-4694-9cbf-76f5eb94276f tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 200 len: 1309 microversion: 2.1 time: 0.095296 May 27 20:04:16.281312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 562/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:04:16 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:04:17.299343 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:04:17.300041 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] [instance: 22eb350a-5651-431a-8e80-1d0200d94342] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:04:17.306373 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:17.306820 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:17.307577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:04:17.308087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:04:17.323508 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] HTTP exception thrown: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Request method failure captured: May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 HTTP/1.1 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS5S5E6nRbpi13eFNY6nduV3q_uh7z7Xbd8Y_c6l1MraHXuH8spOWLKHk8tnEzQa3FWX6mqhGr-1H61OUChtscDPn016NIgyEt8qKxVpgoLG3Pk297atQqI5K1kzZaHpq2_m9VH3ntdMI1r54MYi9zVxGaphDQpkNi9lVoSa8FG1AgM May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 0899ff6998fc48d6a83240edb7f27a70 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:04:17.325155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0899ff6998fc48d6a83240edb7f27a70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0899ff6998fc48d6a83240edb7f27a70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0899ff6998fc48d6a83240edb7f27a70", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0899ff6998fc48d6a83240edb7f27a70"}]}] May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 0899ff6998fc48d6a83240edb7f27a70 May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1399457027 May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-VolumesSnapshotTestJSON-1399457027-project May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: d6561b445d3748b8ab088468d9ffe019 May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-VolumesSnapshotTestJSON-1399457027-project May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. May 27 20:04:17.326822 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '22eb350a-5651-431a-8e80-1d0200d94342'} May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:04:17.327945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. May 27 20:04:17.329641 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:04:17.331945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] Returning 404 to user: Instance 22eb350a-5651-431a-8e80-1d0200d94342 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:04:17.331945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5a30e5d8-0a34-4ebf-8168-c00926d6fe75 tempest-VolumesSnapshotTestJSON-1399457027 tempest-VolumesSnapshotTestJSON-1399457027-project] 10.222.0.13 "GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342" status: 404 len: 111 microversion: 2.1 time: 0.032142 May 27 20:04:17.331945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 619/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:04:17 2022] GET /compute/v2.1/servers/22eb350a-5651-431a-8e80-1d0200d94342 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 20:05:16.136786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:16.137806 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:16.331478 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d2a13202-e8f9-4a98-95fa-71fd954ce8f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Action: 'create', calling method: .version_select at 0x7fe1b4a70d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1959745698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSbglaS7umKccXRgIHU3iG4OxP9w9YMf69paxR1Vr88/IHMaYvhW4IIY4JI8c3Z/ws/91/k5xScPdm3PUtPR7QZfjEwRDCsc0rdtBd55ofN3S4rcpkyvjjQ0hikqdxMag=="}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:05:16.354604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-d2a13202-e8f9-4a98-95fa-71fd954ce8f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:05:16.359547 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-d2a13202-e8f9-4a98-95fa-71fd954ce8f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for user 9f022bc3e4e840519bdf4e1afd8d1aa5 and project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'key_pairs'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:05:16.444784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d2a13202-e8f9-4a98-95fa-71fd954ce8f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.312947 May 27 20:05:16.447034 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 563/1182] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 20:05:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:05:34.495732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=8 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:34.496538 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:34.500548 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-502573228", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1959745698", "security_groups": [{"name": "tempest-secgroup-smoke-646400602"}], "block_device_mapping_v2": [{"uuid": "eb8e6c6b-cacc-47ee-948f-65d1b3f21717", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42141f6f-34fb-4a46-8ad3-6a591b0aee2c"}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:05:34.720298 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] validate_networks() for [('42141f6f-34fb-4a46-8ad3-6a591b0aee2c', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:05:35.174182 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:05:35.174607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:05:35.175107 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:05:35.175514 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:05:35.175947 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:05:35.184936 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:35.185404 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:35.186193 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:35.186620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:35.204297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:05:35.209473 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for user 9f022bc3e4e840519bdf4e1afd8d1aa5 and project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:05:35.268788 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:05:35.271000 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb8e6c6b-cacc-47ee-948f-65d1b3f21717',volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:05:35.637410 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-d0cfc58f-2470-4e04-a362-125b13e4ac11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143310 May 27 20:05:35.638357 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 620/1183] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:05:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 20:05:35.645764 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:35.646558 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:35.651046 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-ec7135d4-0dda-48be-88c7-6c9e9d835475 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:35.652280 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-ec7135d4-0dda-48be-88c7-6c9e9d835475 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:35.766053 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-ec7135d4-0dda-48be-88c7-6c9e9d835475 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:35.773517 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-ec7135d4-0dda-48be-88c7-6c9e9d835475 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1094 microversion: 2.1 time: 0.129213 May 27 20:05:35.774064 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 564/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:35 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1094 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:36.789944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:36.790587 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:36.797354 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:36.797804 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:36.798574 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:36.799010 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:36.874126 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:36.882461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ee8e1597-83e0-47c3-a50d-c9a9b715ddcf tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1144 microversion: 2.1 time: 0.096870 May 27 20:05:36.883024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 621/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:36 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:37.900869 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:37.901302 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:37.908789 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:37.909257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:37.910051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:37.910502 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:37.972879 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:37.980423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5bdf722a-ef34-4395-8eee-8dd2d74ec389 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1210 microversion: 2.1 time: 0.084888 May 27 20:05:37.981206 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 565/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:37 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:38.998099 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:38.998701 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:39.004813 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:39.005296 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:39.006059 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:39.006574 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:39.223092 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:39.230983 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-75985e9a-2358-4d58-b80b-5658a2083d7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1277 microversion: 2.1 time: 0.236737 May 27 20:05:39.231546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 622/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:38 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:39.480188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-1d0bc5b9-a3e3-4708-a9ab-d272345f446f req-cb9e8cd6-3e82-4f9f-a761-24d35860cd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338b95c4-819a-4cd5-bfe6-2c9ba0241e3b", "tag": "efa6f8e7-d17b-4645-9534-61d0a385f076"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:05:39.488591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-1d0bc5b9-a3e3-4708-a9ab-d272345f446f req-cb9e8cd6-3e82-4f9f-a761-24d35860cd7d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:39.489060 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-1d0bc5b9-a3e3-4708-a9ab-d272345f446f req-cb9e8cd6-3e82-4f9f-a761-24d35860cd7d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:39.501152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-1d0bc5b9-a3e3-4708-a9ab-d272345f446f req-cb9e8cd6-3e82-4f9f-a761-24d35860cd7d service nova] Creating event network-changed:efa6f8e7-d17b-4645-9534-61d0a385f076 for instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b on hv-cinder-83979 May 27 20:05:39.506148 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-1d0bc5b9-a3e3-4708-a9ab-d272345f446f req-cb9e8cd6-3e82-4f9f-a761-24d35860cd7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030965 May 27 20:05:39.508725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 566/1188] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 20:05:40.247626 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:40.248226 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:40.254807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:40.255189 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:40.255948 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:40.256375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:40.462138 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:40.470082 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-9cc1c4ac-8bf5-429a-85a8-201aebc8eca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.226300 May 27 20:05:40.470766 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 623/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:40 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:41.488975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:41.489666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:41.496388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:41.496832 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:41.497661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:41.498096 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:41.629521 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:41.636876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8db59cbd-a150-463b-be09-e804525f5d96 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.152712 May 27 20:05:41.637470 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 567/1190] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:41 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:42.654267 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:42.654875 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:42.661498 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:42.661953 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:42.662713 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:42.663154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:42.796297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:42.804259 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-06cbe6f7-b11e-4d5e-9cba-bf9377756681 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.153299 May 27 20:05:42.805109 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 624/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:42 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:43.821993 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:43.822550 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:43.829044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:43.829495 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:43.830243 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:43.830670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:43.959374 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:43.966784 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-be9caa33-5742-425c-a75c-0732d667f1ed tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.149315 May 27 20:05:43.967378 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 568/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:43 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:44.984402 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:44.985024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:44.991495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:44.991935 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:44.992690 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:44.993147 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:45.121807 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:45.129391 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-94aa6680-eb0f-42c6-8a1b-f86cc6450c7f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.148871 May 27 20:05:45.129966 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 625/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:44 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:46.147025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:46.147665 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:46.150813 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:46.155703 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:46.156147 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:46.156908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:46.157370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:46.285691 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:46.293602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-c80725d6-a057-49b9-9e06-a03ec0612b20 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.150450 May 27 20:05:46.298294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 569/1194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:46 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:47.310887 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:47.311427 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:47.313236 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:47.313907 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=6 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:47.319155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:47.319607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:47.320407 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:47.320963 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:47.453237 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:47.461272 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-8c84bf59-cacc-4f6b-984d-b2f24eaa5f11 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.153841 May 27 20:05:47.461830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 626/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:47 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:48.479152 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:48.480042 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:48.486296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:48.486737 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:48.487493 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:48.487924 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:48.620906 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:48.628482 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-934ae95b-b89c-4acb-a9e2-c8a8776ce4f2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.154022 May 27 20:05:48.629067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 570/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:48 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:49.645883 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:49.646426 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:49.653440 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:49.653890 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:49.654649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:49.655086 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:49.784899 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:49.792309 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-08ca9041-be4e-411b-a786-f2c0e7dc9bf2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.150726 May 27 20:05:49.792879 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 627/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:49 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:50.811028 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:50.811632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:50.818090 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:50.818532 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:50.819284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:50.819714 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:50.952678 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:50.960440 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-5b1ba06d-16ce-4538-a547-464869ce5ca8 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.155076 May 27 20:05:50.961024 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 571/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:50 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:51.046565 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-130c78d1-24e6-48bd-bc13-56e5eedb3b9a req-4b825e3c-1004-4885-bed7-bc06aac1533d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338b95c4-819a-4cd5-bfe6-2c9ba0241e3b", "name": "network-vif-plugged", "status": "completed", "tag": "efa6f8e7-d17b-4645-9534-61d0a385f076"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:05:51.055607 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-130c78d1-24e6-48bd-bc13-56e5eedb3b9a req-4b825e3c-1004-4885-bed7-bc06aac1533d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:51.056049 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-130c78d1-24e6-48bd-bc13-56e5eedb3b9a req-4b825e3c-1004-4885-bed7-bc06aac1533d service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:51.066918 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-130c78d1-24e6-48bd-bc13-56e5eedb3b9a req-4b825e3c-1004-4885-bed7-bc06aac1533d service nova] Creating event network-vif-plugged:efa6f8e7-d17b-4645-9534-61d0a385f076 for instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b on hv-cinder-83979 May 27 20:05:51.072717 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-130c78d1-24e6-48bd-bc13-56e5eedb3b9a req-4b825e3c-1004-4885-bed7-bc06aac1533d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 May 27 20:05:51.077729 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 628/1199] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:05:51.977578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:51.978167 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:51.984682 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:51.985177 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:51.985936 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:51.986372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:52.118476 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:52.125831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-97a966be-3ea9-4e29-b2c6-87fd0ed97ef1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1265 microversion: 2.1 time: 0.152188 May 27 20:05:52.126406 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 572/1200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:51 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:53.143670 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:53.144394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:53.151409 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:53.151851 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:53.152612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:53.153074 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:53.286530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:53.294139 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-18a9c02f-69b1-412a-a187-09b1ad83a721 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1452 microversion: 2.1 time: 0.155154 May 27 20:05:53.294710 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 629/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:53 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:05:53.310671 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:05:53.311284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:05:53.317816 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:53.318308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:53.321976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:53.321976 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:53.448591 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:05:53.456115 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-63c6b1b8-21d6-4dd1-8247-fed4ac31b675 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1452 microversion: 2.1 time: 0.149377 May 27 20:05:53.456681 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 573/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:05:53 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:05:55.512493 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-ab40234e-6809-465a-b777-a570a260d8a0 req-c1ef8b07-af4d-4448-8a3b-f37377b46b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338b95c4-819a-4cd5-bfe6-2c9ba0241e3b", "tag": "efa6f8e7-d17b-4645-9534-61d0a385f076"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:05:55.520830 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-ab40234e-6809-465a-b777-a570a260d8a0 req-c1ef8b07-af4d-4448-8a3b-f37377b46b65 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:05:55.521307 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-ab40234e-6809-465a-b777-a570a260d8a0 req-c1ef8b07-af4d-4448-8a3b-f37377b46b65 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:05:55.533491 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-ab40234e-6809-465a-b777-a570a260d8a0 req-c1ef8b07-af4d-4448-8a3b-f37377b46b65 service nova] Creating event network-changed:efa6f8e7-d17b-4645-9534-61d0a385f076 for instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b on hv-cinder-83979 May 27 20:05:55.538648 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-ab40234e-6809-465a-b777-a570a260d8a0 req-c1ef8b07-af4d-4448-8a3b-f37377b46b65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093421 May 27 20:05:55.539302 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 630/1203] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:07:03.665629 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:07:03.666318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:07:49.877471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=22 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:49.878140 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=50 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:49.882664 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:49.883153 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:49.889070 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:49.892876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:49.892876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:49.892876 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:49.915771 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:07:50.159529 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7bb5bda0-ea81-4075-903c-d9314bbe488a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "DELETE /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 204 len: 0 microversion: 2.1 time: 0.283791 May 27 20:07:50.160068 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 574/1204] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:07:49 2022] DELETE /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:07:50.167715 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1df1c4a7-2a3a-4fe0-98be-200880041069] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 27 20:07:50.173087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:50.173087 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=54 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:50.173481 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:50.174169 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:50.180914 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:50.181395 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:50.182150 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:50.182654 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:50.318229 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:50.327996 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4dc25da7-1aaa-4190-89be-5d987f5464e9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1576 microversion: 2.1 time: 0.163514 May 27 20:07:50.328554 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 631/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:50 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:51.345788 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:51.346476 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:51.353323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:51.354016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:51.354767 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:51.355194 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:51.486072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:51.494247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-e22e0c7a-4ef4-47b3-944e-44305d949aa6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1576 microversion: 2.1 time: 0.152625 May 27 20:07:51.494808 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 575/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:51 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:52.512058 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:52.514219 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:52.522500 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:52.523280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:52.524588 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:52.525279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:52.536212 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] [1df1c4a7-2a3a-4fe0-98be-200880041069] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37812. May 27 20:07:52.595181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-2fabf4b7-75c8-4df2-8f81-afbf8618d759 req-08d8bdc4-ce3e-4fd7-a2ed-770323cf1394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338b95c4-819a-4cd5-bfe6-2c9ba0241e3b", "name": "network-vif-deleted", "tag": "efa6f8e7-d17b-4645-9534-61d0a385f076"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:07:52.611170 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-2fabf4b7-75c8-4df2-8f81-afbf8618d759 req-08d8bdc4-ce3e-4fd7-a2ed-770323cf1394 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:52.611628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-2fabf4b7-75c8-4df2-8f81-afbf8618d759 req-08d8bdc4-ce3e-4fd7-a2ed-770323cf1394 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:52.611881 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:52.621662 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-24e94aef-170b-43c1-9f06-a511bda58864 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1509 microversion: 2.1 time: 0.113373 May 27 20:07:52.622605 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 632/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:52 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1509 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:52.634822 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-2fabf4b7-75c8-4df2-8f81-afbf8618d759 req-08d8bdc4-ce3e-4fd7-a2ed-770323cf1394 service nova] Creating event network-vif-deleted:efa6f8e7-d17b-4645-9534-61d0a385f076 for instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b on hv-cinder-83979 May 27 20:07:52.642719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-2fabf4b7-75c8-4df2-8f81-afbf8618d759 req-08d8bdc4-ce3e-4fd7-a2ed-770323cf1394 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113091 May 27 20:07:52.645601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 576/1208] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:07:53.638370 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:53.638995 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:53.645451 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:53.645893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:53.647474 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:53.647894 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:53.677502 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:53.677945 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:53.678386 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.objects.instance [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lazy-loading 'fault' on Instance uuid 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b {{(pid=124677) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 20:07:53.720546 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:53.728344 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3642c080-86b5-4be3-ab42-933fc1f17535 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 200 len: 1230 microversion: 2.1 time: 0.093893 May 27 20:07:53.729239 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 633/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:53 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:54.746763 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:54.747524 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:54.753780 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:54.754219 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:54.754975 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:54.755403 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:54.769239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] HTTP exception thrown: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Request method failure captured: May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b HTTP/1.1 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS719Ize8kmuwt8dUJwGwuQz9tjyun55C4KZG9qadn4jQYBujdZeon3nl9TEGJFhP0TCo_lBGt4RzYww5tmN4ddDFfIcnhWWH33U-6W-Id3Va53SXzDaYoHVUz_JC2eYlNJWnppzEYZMYX5ZGicCxAe3oWiEQpp6g7F1SbkzVnJqzsg May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 20:07:54.770829 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_369b202dfd5943459ccf6864e00cf1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/369b202dfd5943459ccf6864e00cf1f9"}]}] May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-TestVolumeBootPattern-60164326 May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-TestVolumeBootPattern-60164326-project May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 9f022bc3e4e840519bdf4e1afd8d1aa5 May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-TestVolumeBootPattern-60164326-project May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:07:54.773139 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '338b95c4-819a-4cd5-bfe6-2c9ba0241e3b'} May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:07:54.774294 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:07:54.775972 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:07:54.777579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Returning 404 to user: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:07:54.777579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-86a5da60-d132-40e9-948d-f0377f6f9af1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 404 len: 111 microversion: 2.1 time: 0.031089 May 27 20:07:54.777579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 577/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:54 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:07:54.820132 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-124849963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1959745698", "security_groups": [{"name": "tempest-secgroup-smoke-646400602"}], "block_device_mapping_v2": [{"uuid": "eb8e6c6b-cacc-47ee-948f-65d1b3f21717", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42141f6f-34fb-4a46-8ad3-6a591b0aee2c"}]}} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:07:54.933215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.network.neutron [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] validate_networks() for [('42141f6f-34fb-4a46-8ad3-6a591b0aee2c', None, None, None, None, None)] {{(pid=124677) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:07:55.300341 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:07:55.300787 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image limits 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:07:55.301294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:07:55.301712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image pref 0:0:0 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:07:55.302122 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.virt.hardware [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124677) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:07:55.311052 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:55.311490 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:55.312280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:07:55.312706 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:07:55.329589 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:07:55.333417 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.quota [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for user 9f022bc3e4e840519bdf4e1afd8d1aa5 and project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124677) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:07:55.390946 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Going to run 1 instances... {{(pid=124677) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:07:55.393215 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb8e6c6b-cacc-47ee-948f-65d1b3f21717',volume_size=None,volume_type=None)] {{(pid=124677) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:07:55.768675 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [8a1dbf44-7932-4bcf-a432-5cb7dd2d3349] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 20:07:56.776153 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [8a1dbf44-7932-4bcf-a432-5cb7dd2d3349] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 37840. May 27 20:07:56.779990 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-407e93bf-1419-4e44-a3f5-149c014e4d91 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.963798 May 27 20:07:56.780637 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 634/1211] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:07:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 20:07:56.791216 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b078066d-0d80-42c4-b868-5857ca7e0d54 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:56.791826 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b078066d-0d80-42c4-b868-5857ca7e0d54 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:56.848848 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b078066d-0d80-42c4-b868-5857ca7e0d54 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:56.857128 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b078066d-0d80-42c4-b868-5857ca7e0d54 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1094 microversion: 2.1 time: 0.070486 May 27 20:07:56.857679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 578/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:56 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:57.875095 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-303750e3-7764-46de-ad3b-b09032a63310 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:57.875694 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-303750e3-7764-46de-ad3b-b09032a63310 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:57.929762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-303750e3-7764-46de-ad3b-b09032a63310 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:57.936397 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-303750e3-7764-46de-ad3b-b09032a63310 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1094 microversion: 2.1 time: 0.065613 May 27 20:07:57.936943 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 635/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:57 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:07:58.953601 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-757bc3cf-678d-43a9-95e8-09168e4a881c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:07:58.954239 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-757bc3cf-678d-43a9-95e8-09168e4a881c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:07:59.007543 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-757bc3cf-678d-43a9-95e8-09168e4a881c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:07:59.014257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-757bc3cf-678d-43a9-95e8-09168e4a881c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1094 microversion: 2.1 time: 0.064478 May 27 20:07:59.014882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 579/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:07:58 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:00.030994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-66c6d5e8-8751-4095-a703-7d195619dc29 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:00.031593 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-66c6d5e8-8751-4095-a703-7d195619dc29 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:00.083235 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-66c6d5e8-8751-4095-a703-7d195619dc29 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:00.090017 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-66c6d5e8-8751-4095-a703-7d195619dc29 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1094 microversion: 2.1 time: 0.062868 May 27 20:08:00.090574 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 636/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:00 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:01.107650 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:01.108227 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:01.117438 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:01.117882 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:01.118638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:01.119067 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:01.177540 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:01.185049 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-3104adbe-0566-45f4-bd1b-f1ec48f466a1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1144 microversion: 2.1 time: 0.081572 May 27 20:08:01.185604 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 580/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:01 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:02.202025 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:02.202632 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:02.210075 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:02.211845 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:02.211980 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:02.212428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:02.277777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:02.285403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4794d77f-5a6d-4afd-b763-ff37c65fa55a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1192 microversion: 2.1 time: 0.087282 May 27 20:08:02.285972 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 637/1217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:02 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:03.303120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:03.303826 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:03.311249 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:03.311774 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:03.312581 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:03.313040 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:03.383040 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:03.389073 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1a966ef2-248c-4d7d-bc6f-58858f2b03c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1210 microversion: 2.1 time: 0.089931 May 27 20:08:03.389649 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 581/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:03 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:04.407895 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:04.409155 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:04.416992 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:04.417428 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:04.418216 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:04.418654 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:04.702442 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:04.709916 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-43f41aee-3ee3-48d6-a3b0-8cc2f4d56f87 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.306137 May 27 20:08:04.711252 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 638/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:04 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:04.864253 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-8739163a-f048-40ca-a1fc-a4852dc6ed40 req-a4064145-7a30-4afe-87de-441b4573e6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64181c6-d734-4fae-bb75-0ae44eb4ae47", "tag": "e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:08:04.877657 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8739163a-f048-40ca-a1fc-a4852dc6ed40 req-a4064145-7a30-4afe-87de-441b4573e6ab service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:04.881136 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-8739163a-f048-40ca-a1fc-a4852dc6ed40 req-a4064145-7a30-4afe-87de-441b4573e6ab service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:04.890614 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-8739163a-f048-40ca-a1fc-a4852dc6ed40 req-a4064145-7a30-4afe-87de-441b4573e6ab service nova] Creating event network-changed:e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd for instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 on hv-cinder-83979 May 27 20:08:04.895595 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-8739163a-f048-40ca-a1fc-a4852dc6ed40 req-a4064145-7a30-4afe-87de-441b4573e6ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035512 May 27 20:08:04.896436 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 582/1220] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:08:05.728261 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:05.728929 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:05.731024 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:05.736335 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:05.736777 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:05.737631 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:05.742257 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:05.870780 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:05.878262 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1bd05e8a-2e51-41a2-98d0-134f2c8e5f3d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.154573 May 27 20:08:05.878819 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 639/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:05 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:06.894899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:06.895628 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:06.902016 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:06.902465 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:06.903229 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:06.903666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:07.041224 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:07.048844 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-169b6d04-302c-4d83-94af-d7bb8e9a870e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.158665 May 27 20:08:07.049431 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 583/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:06 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:08.068127 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:08.068736 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:08.076184 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:08.076634 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:08.077432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:08.077864 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:08.208838 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:08.216821 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-6bfea40f-2c63-490c-9efd-d1c502fb839c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.152547 May 27 20:08:08.217429 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 640/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:08 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:09.233718 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:09.234349 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:09.236423 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=4 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:09.241242 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:09.241757 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:09.242552 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:09.242983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:09.370847 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:09.378257 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6aa04b51-4110-4e62-bfc4-4655aca4ea93 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.148748 May 27 20:08:09.378825 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 584/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:09 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:10.394768 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:10.395385 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:10.397645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=10 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:10.403055 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:10.403505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:10.404267 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:10.404698 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:10.536013 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:10.544012 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b1f2b4bd-2dd2-43d1-b71b-d2f39e9b26bd tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.153131 May 27 20:08:10.544572 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 641/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:10 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:11.560372 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:11.560986 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:11.567397 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:11.567837 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:11.568590 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:11.569114 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:11.703370 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:11.711296 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7646144f-83b3-4a95-ba31-d36e22a93fcc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.154257 May 27 20:08:11.711850 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 585/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:11 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:12.728351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:12.728984 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:12.735689 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:12.736130 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:12.736876 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:12.737333 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:12.867194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:12.874558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-4794222b-134b-45ff-a523-3e13086e45ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.150668 May 27 20:08:12.875117 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 642/1227] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:12 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:13.892747 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:13.893501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:13.900713 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:13.901260 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:13.902098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:13.902622 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:14.041129 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:14.048578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-27adff8d-5642-4623-994f-7d80c6175fe3 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.159852 May 27 20:08:14.049692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 586/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:13 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:15.066103 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:15.066661 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:15.073363 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:15.073808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:15.074559 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:15.074994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:15.211659 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:15.217812 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3f148843-249d-4f40-92cb-6663ec470d59 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.155617 May 27 20:08:15.218411 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 643/1229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:15 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:08:16.029605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [req-4f8b35da-857d-42a0-804e-88efa8e1da8f req-2038d851-19d5-4991-81cf-6a0f699b95ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64181c6-d734-4fae-bb75-0ae44eb4ae47", "name": "network-vif-plugged", "status": "completed", "tag": "e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd"}]} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:08:16.031602 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4f8b35da-857d-42a0-804e-88efa8e1da8f req-2038d851-19d5-4991-81cf-6a0f699b95ce service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:16.032038 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [req-4f8b35da-857d-42a0-804e-88efa8e1da8f req-2038d851-19d5-4991-81cf-6a0f699b95ce service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:16.042693 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.compute.server_external_events [req-4f8b35da-857d-42a0-804e-88efa8e1da8f req-2038d851-19d5-4991-81cf-6a0f699b95ce service nova] Creating event network-vif-plugged:e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd for instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 on hv-cinder-83979 May 27 20:08:16.047636 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [req-4f8b35da-857d-42a0-804e-88efa8e1da8f req-2038d851-19d5-4991-81cf-6a0f699b95ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082547 May 27 20:08:16.048366 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 587/1230] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:08:16.235483 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:16.236192 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:16.243651 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:16.244094 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:16.244857 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:16.245310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:16.420389 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:16.428774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-3930bf3c-19de-4508-a572-ba2deca6f2de tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.197019 May 27 20:08:16.429512 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 644/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:16 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:17.446644 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:17.447337 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:17.453475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:17.453913 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:17.454670 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:17.455098 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:17.593111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:17.600410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-6d66b2e9-156e-4c6c-bf31-d9fb6fb334d1 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1265 microversion: 2.1 time: 0.158469 May 27 20:08:17.601519 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 588/1232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:17 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:08:18.618242 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:18.618844 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:18.625645 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:18.626083 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:18.626861 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:18.627294 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:18.757994 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:18.765388 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-1529007c-39dc-43ca-a670-862fdda8c697 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1452 microversion: 2.1 time: 0.151548 May 27 20:08:18.765884 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 645/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:18 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:18.781526 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:08:18.782131 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:08:18.788685 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:18.789272 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:18.790044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:18.790475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:18.918433 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:08:18.926134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-4c6da8f4-31a1-4103-9f38-ce76bc14a5c5 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1452 microversion: 2.1 time: 0.148456 May 27 20:08:18.926724 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 589/1234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:08:18 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:08:21.092414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-06fdf524-1ead-4a60-a401-f24a58920c98 req-11aae476-c636-4d7a-853d-1eb6ee41a20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64181c6-d734-4fae-bb75-0ae44eb4ae47", "tag": "e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:08:21.096375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:21.101866 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-06fdf524-1ead-4a60-a401-f24a58920c98 req-11aae476-c636-4d7a-853d-1eb6ee41a20b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:08:21.102318 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-06fdf524-1ead-4a60-a401-f24a58920c98 req-11aae476-c636-4d7a-853d-1eb6ee41a20b service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:08:21.106379 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=77 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:21.113927 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-06fdf524-1ead-4a60-a401-f24a58920c98 req-11aae476-c636-4d7a-853d-1eb6ee41a20b service nova] Creating event network-changed:e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd for instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 on hv-cinder-83979 May 27 20:08:21.119285 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-06fdf524-1ead-4a60-a401-f24a58920c98 req-11aae476-c636-4d7a-853d-1eb6ee41a20b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 May 27 20:08:21.119950 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 646/1235] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:08:39.810624 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:08:39.811204 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:09:55.264888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:55.265661 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:55.269553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1297554396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1959745698", "security_groups": [{"name": "tempest-secgroup-smoke-646400602"}], "block_device_mapping_v2": [{"uuid": "5f5b343b-2576-46f7-8fe1-02787317435e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42141f6f-34fb-4a46-8ad3-6a591b0aee2c"}]}} {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:09:55.381968 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.network.neutron [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] validate_networks() for [('42141f6f-34fb-4a46-8ad3-6a591b0aee2c', None, None, None, None, None)] {{(pid=124678) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 20:09:55.788770 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 20:09:55.789230 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image limits 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 20:09:55.789697 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Flavor pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 20:09:55.790117 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Image pref 0:0:0 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 20:09:55.790518 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.virt.hardware [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 20:09:55.799197 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:55.799638 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:55.800422 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:55.800849 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:55.817063 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 20:09:55.820884 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.quota [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Getting quotas for user 9f022bc3e4e840519bdf4e1afd8d1aa5 and project 369b202dfd5943459ccf6864e00cf1f9. Resources: {'cores', 'ram', 'instances'} {{(pid=124678) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 20:09:55.878762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Going to run 1 instances... {{(pid=124678) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 20:09:55.884055 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f5b343b-2576-46f7-8fe1-02787317435e',volume_size=None,volume_type=None)] {{(pid=124678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 20:09:56.295395 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f69c3948-421d-47f9-bab4-c54be042ef64 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.032017 May 27 20:09:56.296295 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 590/1236] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 20:09:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 20:09:56.306172 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1df1c4a7-2a3a-4fe0-98be-200880041069] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 27 20:09:56.312762 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-75bf02da-4c89-4fc6-aa23-12f3161883a6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:09:56.313558 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-75bf02da-4c89-4fc6-aa23-12f3161883a6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:09:56.372896 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-75bf02da-4c89-4fc6-aa23-12f3161883a6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:09:56.380008 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-75bf02da-4c89-4fc6-aa23-12f3161883a6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1095 microversion: 2.1 time: 0.076672 May 27 20:09:56.380359 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 647/1237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:09:56 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:09:57.397753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:09:57.398410 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:09:57.404491 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:57.404938 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:57.405718 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:57.406149 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:57.467109 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:09:57.475619 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-7010534b-dce3-4564-ae80-1e5928226be2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1145 microversion: 2.1 time: 0.083107 May 27 20:09:57.476188 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 591/1238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:09:57 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:09:58.493121 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:09:58.493722 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:09:58.502751 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:58.505712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:58.505712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:58.505712 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:58.509836 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] [1df1c4a7-2a3a-4fe0-98be-200880041069] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 38010. May 27 20:09:58.576885 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:09:58.584516 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2c23979b-1b59-498d-b4ac-44ce1a0d196e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1211 microversion: 2.1 time: 0.095768 May 27 20:09:58.585118 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 648/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:09:58 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:09:59.601471 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:09:59.602095 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:09:59.609251 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:59.609751 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:59.610632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:59.611247 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:59.765941 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:09:59.774388 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-b719ae9e-8762-4b99-92f5-2e184dbd9528 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.176702 May 27 20:09:59.779214 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 592/1240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:09:59 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:09:59.898432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-4557b791-d568-4126-99b5-096e92b4c9f9 req-ea448dae-c387-4fd1-8d4b-329547c5fbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3dd713-e5bd-4892-830e-be0674fd7667", "tag": "a0aefce1-e7c7-486e-b714-4bf01287765b"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:09:59.908774 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-4557b791-d568-4126-99b5-096e92b4c9f9 req-ea448dae-c387-4fd1-8d4b-329547c5fbe5 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:09:59.916660 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-4557b791-d568-4126-99b5-096e92b4c9f9 req-ea448dae-c387-4fd1-8d4b-329547c5fbe5 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:09:59.929091 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-4557b791-d568-4126-99b5-096e92b4c9f9 req-ea448dae-c387-4fd1-8d4b-329547c5fbe5 service nova] Creating event network-changed:a0aefce1-e7c7-486e-b714-4bf01287765b for instance 3f3dd713-e5bd-4892-830e-be0674fd7667 on hv-cinder-83979 May 27 20:09:59.934440 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-4557b791-d568-4126-99b5-096e92b4c9f9 req-ea448dae-c387-4fd1-8d4b-329547c5fbe5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039980 May 27 20:09:59.935125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 649/1241] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:10:00.791658 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:00.792271 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:00.799034 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:00.799517 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:00.800289 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:00.800794 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:00.934734 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:00.942181 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-55c8e85b-db7c-41cc-aabc-bbc4a09a39fb tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.154652 May 27 20:10:00.942893 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 593/1242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:00 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:01.959492 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:01.960198 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:01.966705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:01.967184 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:01.967988 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:01.968431 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:02.104170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:02.111970 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-ad092da5-0334-4635-9b58-aca7c72806fa tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.157429 May 27 20:10:02.112530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 650/1243] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:01 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:03.128666 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:03.129297 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:03.135978 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:03.136418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:03.137202 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:03.137632 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:03.273004 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:03.280411 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-72009a4b-1bad-4bb0-9fe2-d5202c067c90 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.155658 May 27 20:10:03.281075 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 594/1244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:03 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:04.297770 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:04.298414 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:04.306022 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:04.306577 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:04.307351 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:04.307796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:04.435112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:04.442758 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-b7084ba2-98cd-4bbd-89e1-fc2e0a211aea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.148670 May 27 20:10:04.443571 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 651/1245] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:04 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:05.459883 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:05.460497 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:05.467082 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:05.467528 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:05.468331 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:05.468762 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:05.597439 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:05.605389 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-bfbbd9e8-1603-4f44-bde7-eec21343a82a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.149789 May 27 20:10:05.606717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 595/1246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:05 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:06.622327 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:06.622912 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:06.625360 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell0:SELECT=2 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:06.630668 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:06.631112 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:06.631860 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:06.632289 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:06.763825 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:06.771931 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-54bf0837-52db-43b4-abad-5240c2438836 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.153496 May 27 20:10:06.772499 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 652/1247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:06 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:07.789299 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:07.789904 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:07.791736 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=2 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:07.792400 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell0:SELECT=6 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:07.797284 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:07.802605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:07.802605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:07.802605 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:07.928105 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:07.935505 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-725c2502-0e1a-4989-9ad2-3c3d61c4aa25 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.150512 May 27 20:10:07.936074 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 596/1248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:07 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:08.952832 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:08.953495 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:08.960159 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:08.960611 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:08.961419 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:08.961854 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:09.091530 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:09.099578 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-2b07c539-9380-4d3c-a9cb-e78bad24748c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.150282 May 27 20:10:09.100156 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 653/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:08 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:10.116091 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:10.116717 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:10.123276 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:10.123725 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:10.124483 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:10.124920 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:10.265542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:10.266200 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-f154c3d5-d7c3-45ca-b237-d3b02cd98e68 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.154405 May 27 20:10:10.266740 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 597/1250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:10 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:10.509594 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-1977e150-3e57-4ea5-a79f-96f89b8e1ecd req-d9d95caf-d675-41d1-9ec3-7a983486dfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3dd713-e5bd-4892-830e-be0674fd7667", "name": "network-vif-plugged", "status": "completed", "tag": "a0aefce1-e7c7-486e-b714-4bf01287765b"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:10:10.519088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1977e150-3e57-4ea5-a79f-96f89b8e1ecd req-d9d95caf-d675-41d1-9ec3-7a983486dfad service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:10.519403 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-1977e150-3e57-4ea5-a79f-96f89b8e1ecd req-d9d95caf-d675-41d1-9ec3-7a983486dfad service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:10.531862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-1977e150-3e57-4ea5-a79f-96f89b8e1ecd req-d9d95caf-d675-41d1-9ec3-7a983486dfad service nova] Creating event network-vif-plugged:a0aefce1-e7c7-486e-b714-4bf01287765b for instance 3f3dd713-e5bd-4892-830e-be0674fd7667 on hv-cinder-83979 May 27 20:10:10.537338 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-1977e150-3e57-4ea5-a79f-96f89b8e1ecd req-d9d95caf-d675-41d1-9ec3-7a983486dfad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031482 May 27 20:10:10.542088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 654/1251] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:10:11.283435 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:11.284044 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:11.290719 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:11.291165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:11.291921 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:11.292354 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:11.420679 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:11.428918 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-469eaae2-517c-4b64-99e0-e40959173ac9 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1266 microversion: 2.1 time: 0.149320 May 27 20:10:11.429508 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 598/1252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:11 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:12.446904 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:12.447649 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:12.453862 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:12.454310 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:12.455070 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:12.455505 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:12.586773 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:12.594191 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-af1364b4-95d9-473b-a0b6-9d0ffceecd5e tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1452 microversion: 2.1 time: 0.152082 May 27 20:10:12.594753 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 655/1253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:12 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:12.610866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:10:12.611497 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:10:12.618072 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:12.618520 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:12.619279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:12.619827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:12.754397 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:10:12.762321 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-69b3aeb8-ef5e-4072-a3fb-23571144395c tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1452 microversion: 2.1 time: 0.155671 May 27 20:10:12.762880 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 599/1254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:10:12 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:10:14.655238 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-b45eadf1-ef5b-426f-a98f-b716e2943597 req-f26311b6-2a67-4598-8662-cfac4e2e27dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3dd713-e5bd-4892-830e-be0674fd7667", "tag": "a0aefce1-e7c7-486e-b714-4bf01287765b"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:10:14.664475 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b45eadf1-ef5b-426f-a98f-b716e2943597 req-f26311b6-2a67-4598-8662-cfac4e2e27dc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:10:14.669111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b45eadf1-ef5b-426f-a98f-b716e2943597 req-f26311b6-2a67-4598-8662-cfac4e2e27dc service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:10:14.675647 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-b45eadf1-ef5b-426f-a98f-b716e2943597 req-f26311b6-2a67-4598-8662-cfac4e2e27dc service nova] Creating event network-changed:a0aefce1-e7c7-486e-b714-4bf01287765b for instance 3f3dd713-e5bd-4892-830e-be0674fd7667 on hv-cinder-83979 May 27 20:10:14.680783 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-b45eadf1-ef5b-426f-a98f-b716e2943597 req-f26311b6-2a67-4598-8662-cfac4e2e27dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029163 May 27 20:10:14.681727 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 656/1255] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:10:23.674556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:10:23.675206 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:10:25.276888 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:10:25.277475 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:10:35.992165 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:10:35.992838 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:10:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:11:46.049938 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_api:SELECT=23 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:46.050498 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:46.050908 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:46.051028 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG dbcounter [-] [124677] Writing DB stats nova_cell1:SELECT=43 {{(pid=124677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:46.054261 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:46.054923 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG dbcounter [-] [124678] Writing DB stats nova_cell1:SELECT=56 {{(pid=124678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:46.058578 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:46.059039 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:46.059831 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:46.060266 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:46.090873 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:11:46.112304 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-97378d33-eb8d-4a43-b8c5-fc75c28e2582 req-c650b379-687b-45e8-9974-d28764da1e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3dd713-e5bd-4892-830e-be0674fd7667", "tag": "a0aefce1-e7c7-486e-b714-4bf01287765b"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:11:46.121655 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-97378d33-eb8d-4a43-b8c5-fc75c28e2582 req-c650b379-687b-45e8-9974-d28764da1e61 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:46.122231 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-97378d33-eb8d-4a43-b8c5-fc75c28e2582 req-c650b379-687b-45e8-9974-d28764da1e61 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:46.133306 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-97378d33-eb8d-4a43-b8c5-fc75c28e2582 req-c650b379-687b-45e8-9974-d28764da1e61 service nova] Creating event network-changed:a0aefce1-e7c7-486e-b714-4bf01287765b for instance 3f3dd713-e5bd-4892-830e-be0674fd7667 on hv-cinder-83979 May 27 20:11:46.138800 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-97378d33-eb8d-4a43-b8c5-fc75c28e2582 req-c650b379-687b-45e8-9974-d28764da1e61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090741 May 27 20:11:46.139394 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 657/1256] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:11:46.410815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-16661cc5-8fc3-4945-8539-f0fa8dbd97f4 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 204 len: 0 microversion: 2.1 time: 0.365189 May 27 20:11:46.415025 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 600/1257] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:11:46 2022] DELETE /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:11:46.422461 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:46.423384 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:46.430488 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:46.431007 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:46.432279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:46.432279 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:46.619058 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:46.626604 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-79e310af-895f-4779-a5a2-376a7f692db6 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1576 microversion: 2.1 time: 0.208575 May 27 20:11:46.627161 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 658/1258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:46 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:11:47.645866 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:47.647279 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:47.653857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:47.654312 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:47.655057 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:47.655486 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:47.859779 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:47.868596 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-1e19fb46-2db6-4080-9040-dd3aa6835348 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1576 microversion: 2.1 time: 0.227429 May 27 20:11:47.869530 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 601/1259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:47 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:11:48.426597 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-3b552f32-a191-4ba0-a220-5bbff03ca4f4 req-c4294460-6fd3-4a16-9649-7e4df588a028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3dd713-e5bd-4892-830e-be0674fd7667", "name": "network-vif-deleted", "tag": "a0aefce1-e7c7-486e-b714-4bf01287765b"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:11:48.435728 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3b552f32-a191-4ba0-a220-5bbff03ca4f4 req-c4294460-6fd3-4a16-9649-7e4df588a028 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:48.438993 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-3b552f32-a191-4ba0-a220-5bbff03ca4f4 req-c4294460-6fd3-4a16-9649-7e4df588a028 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:48.447154 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-3b552f32-a191-4ba0-a220-5bbff03ca4f4 req-c4294460-6fd3-4a16-9649-7e4df588a028 service nova] Creating event network-vif-deleted:a0aefce1-e7c7-486e-b714-4bf01287765b for instance 3f3dd713-e5bd-4892-830e-be0674fd7667 on hv-cinder-83979 May 27 20:11:48.452088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-3b552f32-a191-4ba0-a220-5bbff03ca4f4 req-c4294460-6fd3-4a16-9649-7e4df588a028 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029326 May 27 20:11:48.452676 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 659/1260] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:11:48.886700 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:48.888298 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:48.895051 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:48.895503 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:48.896309 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:48.896746 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:48.962735 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:48.970407 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-81d3a86a-8078-46df-83f0-9e6c1a9d4a5d tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 200 len: 1226 microversion: 2.1 time: 0.087834 May 27 20:11:48.970969 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 602/1261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:48 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:11:49.989079 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:49.989769 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 3f3dd713-e5bd-4892-830e-be0674fd7667] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:49.996977 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:49.997524 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:49.998271 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:49.998796 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:50.011921 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] HTTP exception thrown: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Request method failure captured: May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 HTTP/1.1 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS719Ize8kmuwt8dUJwGwuQz9tjyun55C4KZG9qadn4jQYBujdZeon3nl9TEGJFhP0TCo_lBGt4RzYww5tmN4ddDFfIcnhWWH33U-6W-Id3Va53SXzDaYoHVUz_JC2eYlNJWnppzEYZMYX5ZGicCxAe3oWiEQpp6g7F1SbkzVnJqzsg May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:11:50.013620 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_369b202dfd5943459ccf6864e00cf1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/369b202dfd5943459ccf6864e00cf1f9"}]}] May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-TestVolumeBootPattern-60164326 May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 9f022bc3e4e840519bdf4e1afd8d1aa5 May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. May 27 20:11:50.015449 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '3f3dd713-e5bd-4892-830e-be0674fd7667'} May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:11:50.016494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. May 27 20:11:50.018280 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:50.019893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Returning 404 to user: Instance 3f3dd713-e5bd-4892-830e-be0674fd7667 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:11:50.019893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-09262989-ebe3-4984-98b6-08f401b1615a tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667" status: 404 len: 111 microversion: 2.1 time: 0.030436 May 27 20:11:50.019893 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 660/1262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:49 2022] GET /compute/v2.1/servers/3f3dd713-e5bd-4892-830e-be0674fd7667 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:11:53.330009 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-5f205f8d-8e99-4680-8bf2-a47ed6f2721b req-49e1706a-f9fa-463f-b4b6-60242e20f5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64181c6-d734-4fae-bb75-0ae44eb4ae47", "tag": "e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:11:53.336542 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:53.337050 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:53.345877 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-5f205f8d-8e99-4680-8bf2-a47ed6f2721b req-49e1706a-f9fa-463f-b4b6-60242e20f5f0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:53.351441 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-5f205f8d-8e99-4680-8bf2-a47ed6f2721b req-49e1706a-f9fa-463f-b4b6-60242e20f5f0 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:53.354126 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:53.354579 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:53.355356 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:53.355786 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:53.368170 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-5f205f8d-8e99-4680-8bf2-a47ed6f2721b req-49e1706a-f9fa-463f-b4b6-60242e20f5f0 service nova] Creating event network-changed:e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd for instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 on hv-cinder-83979 May 27 20:11:53.378934 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-5f205f8d-8e99-4680-8bf2-a47ed6f2721b req-49e1706a-f9fa-463f-b4b6-60242e20f5f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052362 May 27 20:11:53.379592 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 661/1263] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:11:53.390868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Going to try to terminate instance {{(pid=124678) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 20:11:53.640408 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-d8086a21-df3a-4a00-a247-69c564b9f78f tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 204 len: 0 microversion: 2.1 time: 0.316284 May 27 20:11:53.641134 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 603/1264] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:11:53 2022] DELETE /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 20:11:53.650149 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:53.650375 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:53.657111 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:53.657366 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:53.658496 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:53.658931 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:53.789557 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.policy [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124677) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:53.797063 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-85b189fa-12e3-444f-a0e0-c427af4ad3b2 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1576 microversion: 2.1 time: 0.151664 May 27 20:11:53.797632 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 662/1265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:53 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:11:54.815213 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:54.815827 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:54.822899 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:54.823350 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:54.824120 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:54.824553 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:54.959293 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:54.967418 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-8c2b3d9e-6e9e-4b0a-bb9c-551c92a49e46 tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1576 microversion: 2.1 time: 0.156479 May 27 20:11:54.970501 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 604/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:54 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 20:11:55.620737 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [req-b4560c87-b0ca-4fa9-845c-9054ad0c0e6b req-ec164e43-e8f8-4d5d-a0dc-ee1068605ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64181c6-d734-4fae-bb75-0ae44eb4ae47", "name": "network-vif-deleted", "tag": "e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd"}]} {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 20:11:55.629297 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b4560c87-b0ca-4fa9-845c-9054ad0c0e6b req-ec164e43-e8f8-4d5d-a0dc-ee1068605ea4 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:55.629732 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [req-b4560c87-b0ca-4fa9-845c-9054ad0c0e6b req-ec164e43-e8f8-4d5d-a0dc-ee1068605ea4 service nova] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:55.640547 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.compute.server_external_events [req-b4560c87-b0ca-4fa9-845c-9054ad0c0e6b req-ec164e43-e8f8-4d5d-a0dc-ee1068605ea4 service nova] Creating event network-vif-deleted:e3c8ac2c-2b0b-4dd0-a3cd-04e7155fd7fd for instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 on hv-cinder-83979 May 27 20:11:55.645512 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [req-b4560c87-b0ca-4fa9-845c-9054ad0c0e6b req-ec164e43-e8f8-4d5d-a0dc-ee1068605ea4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028603 May 27 20:11:55.646088 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 663/1267] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 20:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 20:11:55.986308 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:55.986928 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:55.998326 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:55.998773 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:55.999753 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:56.000330 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:56.069222 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.policy [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f022bc3e4e840519bdf4e1afd8d1aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '369b202dfd5943459ccf6864e00cf1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124678) authorize /opt/stack/nova/nova/policy.py:199}} May 27 20:11:56.077265 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-947f2924-c12b-43db-b3fe-231a3c6990ef tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 200 len: 1225 microversion: 2.1 time: 0.095927 May 27 20:11:56.077815 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 605/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:55 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 20:11:57.095006 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:57.095691 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: c64181c6-d734-4fae-bb75-0ae44eb4ae47] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:57.103186 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.103622 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.104374 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.104944 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.118612 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] HTTP exception thrown: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Request method failure captured: May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 HTTP/1.1 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS719Ize8kmuwt8dUJwGwuQz9tjyun55C4KZG9qadn4jQYBujdZeon3nl9TEGJFhP0TCo_lBGt4RzYww5tmN4ddDFfIcnhWWH33U-6W-Id3Va53SXzDaYoHVUz_JC2eYlNJWnppzEYZMYX5ZGicCxAe3oWiEQpp6g7F1SbkzVnJqzsg May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:11:57.120202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_369b202dfd5943459ccf6864e00cf1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/369b202dfd5943459ccf6864e00cf1f9"}]}] May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 9f022bc3e4e840519bdf4e1afd8d1aa5 May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. May 27 20:11:57.122202 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': 'c64181c6-d734-4fae-bb75-0ae44eb4ae47'} May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:11:57.123274 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. May 27 20:11:57.124874 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.126452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Returning 404 to user: Instance c64181c6-d734-4fae-bb75-0ae44eb4ae47 could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:11:57.126452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-09bb2517-323c-4298-a228-765616743afe tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47" status: 404 len: 111 microversion: 2.1 time: 0.030909 May 27 20:11:57.126452 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 664/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:57 2022] GET /compute/v2.1/servers/c64181c6-d734-4fae-bb75-0ae44eb4ae47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:11:57.596525 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:57.598919 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.compute.api [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124678) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:57.604160 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.604607 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.605398 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.605835 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG oslo_concurrency.lockutils [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.620035 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.wsgi [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] HTTP exception thrown: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Request method failure captured: May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: request: DELETE /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b HTTP/1.1 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept: application/json May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Accept-Encoding: identity May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Connection: close May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Length: 0 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Content-Type: application/json May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Host: 10.222.0.13 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Openstack-System-Scope: None May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: User-Agent: python-urllib3/1.26.9 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Auth-Token: gAAAAABikS719Ize8kmuwt8dUJwGwuQz9tjyun55C4KZG9qadn4jQYBujdZeon3nl9TEGJFhP0TCo_lBGt4RzYww5tmN4ddDFfIcnhWWH33U-6W-Id3Va53SXzDaYoHVUz_JC2eYlNJWnppzEYZMYX5ZGicCxAe3oWiEQpp6g7F1SbkzVnJqzsg May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Id: None May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Domain-Name: None May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Identity-Status: Confirmed May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Is-Admin-Project: True May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Id: default May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Domain-Name: Default May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Project-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Role: reader,member May 27 20:11:57.621692 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Roles: reader,member May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_369b202dfd5943459ccf6864e00cf1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/369b202dfd5943459ccf6864e00cf1f9"}]}] May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-Tenant-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Id: default May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Domain-Name: Default May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Id: 9f022bc3e4e840519bdf4e1afd8d1aa5 May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: X-User-Name: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: method: > May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: exception: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.623441 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: action_args: {'id': '338b95c4-819a-4cd5-bfe6-2c9ba0241e3b'} May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:11:57.624444 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.626111 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: ERROR nova.api.openstack.wsgi May 27 20:11:57.627868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Returning 404 to user: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. {{(pid=124678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:11:57.627868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-0b509d70-07d6-4dde-b048-ccf5a45b9bdc tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "DELETE /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 404 len: 111 microversion: 2.1 time: 0.030396 May 27 20:11:57.627868 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 606/1270] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 20:11:57 2022] DELETE /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:11:57.631693 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '>' {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:57.632325 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.compute.api [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] [instance: 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b] Fetching instance by UUID {{(pid=124677) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 20:11:57.638356 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.638808 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.639556 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 20:11:57.639987 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG oslo_concurrency.lockutils [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Lock "d7766c91-01df-49b1-b027-e27fc837f25b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124677) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 20:11:57.653014 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.wsgi [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] HTTP exception thrown: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Request method failure captured: May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: request: GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b HTTP/1.1 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept: application/json May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Accept-Encoding: identity May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Connection: close May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Length: 0 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Content-Type: application/json May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Host: 10.222.0.13 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Openstack-System-Scope: None May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: User-Agent: python-urllib3/1.26.9 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Auth-Token: gAAAAABikS719Ize8kmuwt8dUJwGwuQz9tjyun55C4KZG9qadn4jQYBujdZeon3nl9TEGJFhP0TCo_lBGt4RzYww5tmN4ddDFfIcnhWWH33U-6W-Id3Va53SXzDaYoHVUz_JC2eYlNJWnppzEYZMYX5ZGicCxAe3oWiEQpp6g7F1SbkzVnJqzsg May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Id: None May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Domain-Name: None May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Identity-Status: Confirmed May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Is-Admin-Project: True May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Id: default May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Domain-Name: Default May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Project-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Role: reader,member May 27 20:11:57.654494 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Roles: reader,member May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/369b202dfd5943459ccf6864e00cf1f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_369b202dfd5943459ccf6864e00cf1f9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/369b202dfd5943459ccf6864e00cf1f9"}]}] May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Id: 369b202dfd5943459ccf6864e00cf1f9 May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-Tenant-Name: tempest-TestVolumeBootPattern-60164326 May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Id: default May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Domain-Name: Default May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Id: 9f022bc3e4e840519bdf4e1afd8d1aa5 May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: X-User-Name: tempest-TestVolumeBootPattern-60164326-project May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: method: > May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: exception: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.656214 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: action_args: {'id': '338b95c4-819a-4cd5-bfe6-2c9ba0241e3b'} May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: {{(pid=124677) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 20:11:57.657432 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. May 27 20:11:57.659218 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: ERROR nova.api.openstack.wsgi May 27 20:11:57.661539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: DEBUG nova.api.openstack.wsgi [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Returning 404 to user: Instance 338b95c4-819a-4cd5-bfe6-2c9ba0241e3b could not be found. {{(pid=124677) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 20:11:57.661539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO nova.api.openstack.requestlog [None req-5a195fb2-9968-41df-8b61-268a208ff9ec tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b" status: 404 len: 111 microversion: 2.1 time: 0.027932 May 27 20:11:57.661539 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: [pid: 124677|app: 0|req: 665/1271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 20:11:57 2022] GET /compute/v2.1/servers/338b95c4-819a-4cd5-bfe6-2c9ba0241e3b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 20:11:59.088857 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: DEBUG nova.api.openstack.wsgi [None req-aae56678-1344-47da-9ef1-7dd33b702bea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] Calling method '.version_select at 0x7fe1b4974b80>' {{(pid=124678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 20:11:59.178323 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO nova.api.openstack.requestlog [None req-aae56678-1344-47da-9ef1-7dd33b702bea tempest-TestVolumeBootPattern-60164326 tempest-TestVolumeBootPattern-60164326-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1959745698" status: 202 len: 0 microversion: 2.1 time: 0.093581 May 27 20:11:59.179017 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: [pid: 124678|app: 0|req: 607/1272] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 20:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1959745698 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 20:13:43.683125 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:13:43.683698 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:13:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:13:54.293827 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:13:54.294476 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:15:19.822387 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:15:19.822983 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:17:03.691517 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:17:03.692151 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:17:05.288404 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:17:05.289021 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:17:14.302194 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:17:14.302705 dv-cinder-839793-12-iscsi devstack@n-api.service[124677]: Fri May 27 20:17:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 20:17:16.004587 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 20:17:16.005220 dv-cinder-839793-12-iscsi devstack@n-api.service[124678]: Fri May 27 20:17:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!